Skip to content

Enable ListLayout in CI SQL Benchmarks - #8809

Draft
mhk197 wants to merge 1 commit into
developfrom
mk/enable-list-layout-bench
Draft

Enable ListLayout in CI SQL Benchmarks#8809
mhk197 wants to merge 1 commit into
developfrom
mk/enable-list-layout-bench

Conversation

@mhk197

@mhk197 mhk197 commented Jul 16, 2026

Copy link
Copy Markdown
Contributor

No description provided.

@mhk197 mhk197 added do not merge Pull requests that are not intended to merge action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Jul 16, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 16, 2026
@github-actions

github-actions Bot commented Jul 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Vortex queries

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+3.6%, low confidence) · DuckDB No clear signal (-3.1%, low confidence)
Vortex (geomean): 0.976x ➖
Parquet (geomean): 0.975x ➖
Shifts: Parquet (control) -2.5% · Median polish -2.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.986x ➖, 0↑ 0↓)
name PR 6ce102b (ns) base 407720c (ns) ratio (PR/base)
vortex_q00/datafusion:vortex-file-compressed 9529740 9824979 0.97
vortex_q01/datafusion:vortex-file-compressed 6373135 6363061 1.00
datafusion / parquet (0.952x ➖, 0↑ 0↓)
name PR 6ce102b (ns) base 407720c (ns) ratio (PR/base)
vortex_q00/datafusion:parquet 19849524 20817537 0.95
vortex_q01/datafusion:parquet 4608861 4851302 0.95
duckdb / vortex-file-compressed (0.968x ➖, 0↑ 0↓)
name PR 6ce102b (ns) base 407720c (ns) ratio (PR/base)
vortex_q00/duckdb:vortex-file-compressed 10025464 10100030 0.99
vortex_q01/duckdb:vortex-file-compressed 5950862 6304024 0.94
duckdb / parquet (0.999x ➖, 0↑ 0↓)
name PR 6ce102b (ns) base 407720c (ns) ratio (PR/base)
vortex_q00/duckdb:parquet 23295093 23412652 0.99
vortex_q01/duckdb:parquet 9430103 9392853 1.00

No file size changes detected.

@github-actions

github-actions Bot commented Jul 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 9182af3 1 Explore Profiling Data
Previous Runs (3)
Status Commit Job Attempt Link
🟢 Done 8947569 1 Explore Profiling Data
🟢 Done 6ce102b 1 Explore Profiling Data
🟢 Done 862d595 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jul 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (+1.4%, low confidence) · DuckDB No clear signal (-0.3%, low confidence)
Vortex (geomean): 0.993x ➖
Parquet (geomean): 0.988x ➖
Shifts: Parquet (control) -1.2% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.000x ➖, 0↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 4363511 4421112 0.99
fineweb_q01/datafusion:vortex-file-compressed 30815340 30731220 1.00
fineweb_q02/datafusion:vortex-file-compressed 35441058 36406206 0.97
fineweb_q03/datafusion:vortex-file-compressed 54846058 54978969 1.00
fineweb_q04/datafusion:vortex-file-compressed 242017647 246363979 0.98
fineweb_q05/datafusion:vortex-file-compressed 184692310 183938638 1.00
fineweb_q06/datafusion:vortex-file-compressed 48223949 48263532 1.00
fineweb_q07/datafusion:vortex-file-compressed 51537769 52664003 0.98
fineweb_q08/datafusion:vortex-file-compressed 20786166 19208214 1.08
datafusion / parquet (0.986x ➖, 0↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 7696425 7423119 1.04
fineweb_q01/datafusion:parquet 282886783 292244667 0.97
fineweb_q02/datafusion:parquet 287425569 299595276 0.96
fineweb_q03/datafusion:parquet 297703010 287288495 1.04
fineweb_q04/datafusion:parquet 308412370 309842151 1.00
fineweb_q05/datafusion:parquet 298326187 307582852 0.97
fineweb_q06/datafusion:parquet 289122388 298732146 0.97
fineweb_q07/datafusion:parquet 278155272 288546286 0.96
fineweb_q08/datafusion:parquet 278033692 283451914 0.98
duckdb / vortex-file-compressed (0.986x ➖, 0↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3026449 3263634 0.93
fineweb_q01/duckdb:vortex-file-compressed 31589429 33708691 0.94
fineweb_q02/duckdb:vortex-file-compressed 37691453 37777829 1.00
fineweb_q03/duckdb:vortex-file-compressed 101727799 100342930 1.01
fineweb_q04/duckdb:vortex-file-compressed 240902947 239104020 1.01
fineweb_q05/duckdb:vortex-file-compressed 186316014 183812476 1.01
fineweb_q06/duckdb:vortex-file-compressed 50828687 50605869 1.00
fineweb_q07/duckdb:vortex-file-compressed 55693375 56611615 0.98
fineweb_q08/duckdb:vortex-file-compressed 20335399 20476656 0.99
duckdb / parquet (0.989x ➖, 0↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 32274335 34062009 0.95
fineweb_q01/duckdb:parquet 91287038 93829015 0.97
fineweb_q02/duckdb:parquet 89427098 88848398 1.01
fineweb_q03/duckdb:parquet 316912429 319579568 0.99
fineweb_q04/duckdb:parquet 447636138 453297540 0.99
fineweb_q05/duckdb:parquet 418614305 419334122 1.00
fineweb_q06/duckdb:parquet 206741938 207035617 1.00
fineweb_q07/duckdb:parquet 219190302 219578154 1.00
fineweb_q08/duckdb:parquet 37307786 37140839 1.00
File Size Changes (2 files changed, -46.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
sample.vortex 1.0 vortex-compact 1.23 GB 0 B 1.23 GB -100.0%

Totals:

  • vortex-compact: 1.23 GB → 0 B (-100.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (0.0%)

@github-actions

github-actions Bot commented Jul 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Vortex (geomean): 1.214x ❌

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.214x ❌, 0↑ 9↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 🚨 173778479 114647057 1.52
polarsignals_q01/datafusion:vortex-file-compressed 🚨 324188338 269477165 1.20
polarsignals_q02/datafusion:vortex-file-compressed 21565274 23252830 0.93
polarsignals_q03/datafusion:vortex-file-compressed 🚨 361480370 262035865 1.38
polarsignals_q04/datafusion:vortex-file-compressed 🚨 12081920 9544069 1.27
polarsignals_q05/datafusion:vortex-file-compressed 🚨 17960754 14593918 1.23
polarsignals_q06/datafusion:vortex-file-compressed 🚨 22938632 20299407 1.13
polarsignals_q07/datafusion:vortex-file-compressed 🚨 15739643 12998708 1.21
polarsignals_q08/datafusion:vortex-file-compressed 🚨 467671838 383128260 1.22
polarsignals_q09/datafusion:vortex-file-compressed 🚨 12278511 10717532 1.15
File Size Changes (1 files changed, -8.2% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 685.83 MB 629.26 MB 56.57 MB -8.2%

Totals:

  • vortex-file-compressed: 685.83 MB → 629.26 MB (-8.2%)

@github-actions

github-actions Bot commented Jul 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Engines: DataFusion No clear signal (-2.0%, environment too noisy confidence) · DuckDB No clear signal (+0.2%, environment too noisy confidence)
Vortex (geomean): 0.958x ➖
Parquet (geomean): 0.967x ➖
Shifts: Parquet (control) -3.3% · Median polish -3.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.949x ➖, 2↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 50654104 52086917 0.97
tpch_q02/datafusion:vortex-file-compressed 21134613 22770871 0.93
tpch_q03/datafusion:vortex-file-compressed 29981503 31271429 0.96
tpch_q04/datafusion:vortex-file-compressed 18344948 18768965 0.98
tpch_q05/datafusion:vortex-file-compressed 44222370 47543286 0.93
tpch_q06/datafusion:vortex-file-compressed 9695171 10188117 0.95
tpch_q07/datafusion:vortex-file-compressed 50154365 53464049 0.94
tpch_q08/datafusion:vortex-file-compressed 37121180 39312441 0.94
tpch_q09/datafusion:vortex-file-compressed 47438999 50850913 0.93
tpch_q10/datafusion:vortex-file-compressed 31892089 33865965 0.94
tpch_q11/datafusion:vortex-file-compressed 15329077 16340322 0.94
tpch_q12/datafusion:vortex-file-compressed 22582313 23182944 0.97
tpch_q13/datafusion:vortex-file-compressed 24284556 25324658 0.96
tpch_q14/datafusion:vortex-file-compressed 🚀 14186991 15770784 0.90
tpch_q15/datafusion:vortex-file-compressed 22317267 23876495 0.93
tpch_q16/datafusion:vortex-file-compressed 18375104 19483753 0.94
tpch_q17/datafusion:vortex-file-compressed 62055810 65386203 0.95
tpch_q18/datafusion:vortex-file-compressed 71321488 74832348 0.95
tpch_q19/datafusion:vortex-file-compressed 🚀 18220286 20280723 0.90
tpch_q20/datafusion:vortex-file-compressed 29077595 29416903 0.99
tpch_q21/datafusion:vortex-file-compressed 66626626 69558028 0.96
tpch_q22/datafusion:vortex-file-compressed 12524887 12267641 1.02
datafusion / parquet (0.969x ➖, 2↑ 1↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 134989180 136789046 0.99
tpch_q02/datafusion:parquet 57545914 60969398 0.94
tpch_q03/datafusion:parquet 78967407 78539644 1.01
tpch_q04/datafusion:parquet 46780823 45530494 1.03
tpch_q05/datafusion:parquet 91829052 95248241 0.96
tpch_q06/datafusion:parquet 41091381 41441554 0.99
tpch_q07/datafusion:parquet 99504777 107384455 0.93
tpch_q08/datafusion:parquet 93081447 93743700 0.99
tpch_q09/datafusion:parquet 🚀 115280406 128349340 0.90
tpch_q10/datafusion:parquet 🚀 101472846 118594544 0.86
tpch_q11/datafusion:parquet 39900063 42831103 0.93
tpch_q12/datafusion:parquet 83068083 77252333 1.08
tpch_q13/datafusion:parquet 191657712 205723626 0.93
tpch_q14/datafusion:parquet 🚨 46812468 42307380 1.11
tpch_q15/datafusion:parquet 61312498 63098502 0.97
tpch_q16/datafusion:parquet 44234246 43165832 1.02
tpch_q17/datafusion:parquet 134209133 143408123 0.94
tpch_q18/datafusion:parquet 150785326 156147798 0.97
tpch_q19/datafusion:parquet 75776387 81556786 0.93
tpch_q20/datafusion:parquet 71320036 74399674 0.96
tpch_q21/datafusion:parquet 140536076 141671083 0.99
tpch_q22/datafusion:parquet 42942717 46157044 0.93
duckdb / vortex-file-compressed (0.967x ➖, 0↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 27455354 28381231 0.97
tpch_q02/duckdb:vortex-file-compressed 24090570 25838059 0.93
tpch_q03/duckdb:vortex-file-compressed 30819094 32755195 0.94
tpch_q04/duckdb:vortex-file-compressed 27182002 28230512 0.96
tpch_q05/duckdb:vortex-file-compressed 33796545 36451963 0.93
tpch_q06/duckdb:vortex-file-compressed 8288054 8462642 0.98
tpch_q07/duckdb:vortex-file-compressed 32714819 34637604 0.94
tpch_q08/duckdb:vortex-file-compressed 38731203 39799915 0.97
tpch_q09/duckdb:vortex-file-compressed 53627059 57192391 0.94
tpch_q10/duckdb:vortex-file-compressed 40273399 42055250 0.96
tpch_q11/duckdb:vortex-file-compressed 13523686 14467694 0.93
tpch_q12/duckdb:vortex-file-compressed 22522753 23587858 0.95
tpch_q13/duckdb:vortex-file-compressed 39061207 40554946 0.96
tpch_q14/duckdb:vortex-file-compressed 19984181 19746603 1.01
tpch_q15/duckdb:vortex-file-compressed 16145289 16566966 0.97
tpch_q16/duckdb:vortex-file-compressed 27188178 28090178 0.97
tpch_q17/duckdb:vortex-file-compressed 22513982 23199990 0.97
tpch_q18/duckdb:vortex-file-compressed 50854947 53441649 0.95
tpch_q19/duckdb:vortex-file-compressed 28857326 26772629 1.08
tpch_q20/duckdb:vortex-file-compressed 30744942 32244737 0.95
tpch_q21/duckdb:vortex-file-compressed 100071268 105231899 0.95
tpch_q22/duckdb:vortex-file-compressed 17569215 16790937 1.05
duckdb / parquet (0.965x ➖, 1↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚀 79518653 105249776 0.76
tpch_q02/duckdb:parquet 41320286 41147927 1.00
tpch_q03/duckdb:parquet 72160833 73067052 0.99
tpch_q04/duckdb:parquet 50176546 51759677 0.97
tpch_q05/duckdb:parquet 69235461 70712047 0.98
tpch_q06/duckdb:parquet 22647800 22966186 0.99
tpch_q07/duckdb:parquet 75157727 82087759 0.92
tpch_q08/duckdb:parquet 91063114 85007890 1.07
tpch_q09/duckdb:parquet 140945937 138865153 1.01
tpch_q10/duckdb:parquet 125566749 132377930 0.95
tpch_q11/duckdb:parquet 22864600 23556874 0.97
tpch_q12/duckdb:parquet 53712344 54950716 0.98
tpch_q13/duckdb:parquet 251286263 269675437 0.93
tpch_q14/duckdb:parquet 51208201 53005275 0.97
tpch_q15/duckdb:parquet 26382809 27597121 0.96
tpch_q16/duckdb:parquet 58979116 60631637 0.97
tpch_q17/duckdb:parquet 57760138 58611244 0.99
tpch_q18/duckdb:parquet 124564516 127790929 0.97
tpch_q19/duckdb:parquet 71212542 75132736 0.95
tpch_q20/duckdb:parquet 66387937 66787203 0.99
tpch_q21/duckdb:parquet 181027907 187647306 0.96
tpch_q22/duckdb:parquet 55524077 56451861 0.98
File Size Changes (10 files changed, -43.9% overall, 0↑ 10↓)
File Scale Format Base HEAD Change %
customer_0.vortex 1.0 vortex-compact 7.40 MB 0 B 7.40 MB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem_0.vortex 1.0 vortex-compact 63.00 MB 0 B 63.00 MB -100.0%
lineitem_1.vortex 1.0 vortex-compact 63.03 MB 0 B 63.03 MB -100.0%
nation_0.vortex 1.0 vortex-compact 7.80 KB 0 B 7.80 KB -100.0%
orders_0.vortex 1.0 vortex-compact 31.73 MB 0 B 31.73 MB -100.0%
part_0.vortex 1.0 vortex-compact 3.55 MB 0 B 3.55 MB -100.0%
partsupp_0.vortex 1.0 vortex-compact 20.29 MB 0 B 20.29 MB -100.0%
region_0.vortex 1.0 vortex-compact 5.83 KB 0 B 5.83 KB -100.0%
supplier_0.vortex 1.0 vortex-compact 496.46 KB 0 B 496.46 KB -100.0%

Totals:

  • vortex-compact: 189.76 MB → 0 B (-100.0%)
  • vortex-file-compressed: 242.92 MB → 242.92 MB (0.0%)

@github-actions

github-actions Bot commented Jul 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.8%
Engines: DataFusion No clear signal (+1.9%, environment too noisy confidence) · DuckDB No clear signal (+1.7%, low confidence)
Vortex (geomean): 1.082x ➖
Parquet (geomean): 1.063x ➖
Shifts: Parquet (control) +6.3% · Median polish +7.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.091x ➖, 0↑ 43↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚨 25174785 21961981 1.15
tpcds_q02/datafusion:vortex-file-compressed 43431194 42847652 1.01
tpcds_q03/datafusion:vortex-file-compressed 15078256 14813822 1.02
tpcds_q04/datafusion:vortex-file-compressed 🚨 244552474 222048851 1.10
tpcds_q05/datafusion:vortex-file-compressed 🚨 49396434 43674644 1.13
tpcds_q06/datafusion:vortex-file-compressed 🚨 26137429 22599146 1.16
tpcds_q07/datafusion:vortex-file-compressed 🚨 49673409 41155664 1.21
tpcds_q08/datafusion:vortex-file-compressed 🚨 33301997 29900696 1.11
tpcds_q09/datafusion:vortex-file-compressed 🚨 35074514 30449641 1.15
tpcds_q10/datafusion:vortex-file-compressed 🚨 44397025 36053349 1.23
tpcds_q11/datafusion:vortex-file-compressed 🚨 142653231 127476474 1.12
tpcds_q12/datafusion:vortex-file-compressed 🚨 18723293 16850911 1.11
tpcds_q13/datafusion:vortex-file-compressed 45545605 44068969 1.03
tpcds_q14/datafusion:vortex-file-compressed 🚨 176148377 158168215 1.11
tpcds_q15/datafusion:vortex-file-compressed 27622727 26679909 1.04
tpcds_q16/datafusion:vortex-file-compressed 24127723 22350672 1.08
tpcds_q17/datafusion:vortex-file-compressed 62026792 57638412 1.08
tpcds_q18/datafusion:vortex-file-compressed 🚨 64800169 57454467 1.13
tpcds_q19/datafusion:vortex-file-compressed 🚨 23652837 21456145 1.10
tpcds_q20/datafusion:vortex-file-compressed 🚨 22204349 18993242 1.17
tpcds_q21/datafusion:vortex-file-compressed 39919221 36643280 1.09
tpcds_q22/datafusion:vortex-file-compressed 125818030 116116676 1.08
tpcds_q23/datafusion:vortex-file-compressed 🚨 167106218 146533392 1.14
tpcds_q24/datafusion:vortex-file-compressed 89690949 86149566 1.04
tpcds_q25/datafusion:vortex-file-compressed 🚨 68316160 60548328 1.13
tpcds_q26/datafusion:vortex-file-compressed 🚨 33033560 29072726 1.14
tpcds_q27/datafusion:vortex-file-compressed 🚨 104278395 93849889 1.11
tpcds_q28/datafusion:vortex-file-compressed 32543887 32631993 1.00
tpcds_q29/datafusion:vortex-file-compressed 🚨 63787412 57397125 1.11
tpcds_q30/datafusion:vortex-file-compressed 🚨 26330036 23810114 1.11
tpcds_q31/datafusion:vortex-file-compressed 74731735 69036921 1.08
tpcds_q32/datafusion:vortex-file-compressed 🚨 18924013 17159893 1.10
tpcds_q33/datafusion:vortex-file-compressed 30616814 28303817 1.08
tpcds_q34/datafusion:vortex-file-compressed 26927105 25469923 1.06
tpcds_q35/datafusion:vortex-file-compressed 🚨 46616810 42155316 1.11
tpcds_q36/datafusion:vortex-file-compressed 🚨 62567569 56843843 1.10
tpcds_q37/datafusion:vortex-file-compressed 🚨 19718737 17864024 1.10
tpcds_q38/datafusion:vortex-file-compressed 43341421 39667321 1.09
tpcds_q39/datafusion:vortex-file-compressed 114886728 105944645 1.08
tpcds_q40/datafusion:vortex-file-compressed 31136909 29685349 1.05
tpcds_q41/datafusion:vortex-file-compressed 21292283 19561924 1.09
tpcds_q42/datafusion:vortex-file-compressed 13783549 13264719 1.04
tpcds_q43/datafusion:vortex-file-compressed 🚨 20116901 18259780 1.10
tpcds_q44/datafusion:vortex-file-compressed 30991043 29153500 1.06
tpcds_q45/datafusion:vortex-file-compressed 26296728 25162385 1.05
tpcds_q46/datafusion:vortex-file-compressed 36089309 34317594 1.05
tpcds_q47/datafusion:vortex-file-compressed 🚨 148072776 133041986 1.11
tpcds_q48/datafusion:vortex-file-compressed 39068628 36734684 1.06
tpcds_q49/datafusion:vortex-file-compressed 61093261 58117228 1.05
tpcds_q50/datafusion:vortex-file-compressed 🚨 42795362 38159078 1.12
tpcds_q51/datafusion:vortex-file-compressed 🚨 99249715 88271614 1.12
tpcds_q52/datafusion:vortex-file-compressed 14034648 13639320 1.03
tpcds_q53/datafusion:vortex-file-compressed 23051708 21256248 1.08
tpcds_q54/datafusion:vortex-file-compressed 34520204 33047800 1.04
tpcds_q55/datafusion:vortex-file-compressed 🚨 15124890 13059542 1.16
tpcds_q56/datafusion:vortex-file-compressed 30877076 29009561 1.06
tpcds_q57/datafusion:vortex-file-compressed 96901408 93367934 1.04
tpcds_q58/datafusion:vortex-file-compressed 🚨 59450168 51889422 1.15
tpcds_q59/datafusion:vortex-file-compressed 60883259 56503692 1.08
tpcds_q60/datafusion:vortex-file-compressed 31142909 29622042 1.05
tpcds_q61/datafusion:vortex-file-compressed 🚨 43152334 38302213 1.13
tpcds_q62/datafusion:vortex-file-compressed 22817479 20946614 1.09
tpcds_q63/datafusion:vortex-file-compressed 🚨 23692748 21065809 1.12
tpcds_q64/datafusion:vortex-file-compressed 🚨 430211467 378952380 1.14
tpcds_q65/datafusion:vortex-file-compressed 54716635 52832193 1.04
tpcds_q66/datafusion:vortex-file-compressed 75381924 69121404 1.09
tpcds_q67/datafusion:vortex-file-compressed 🚨 166187747 149221083 1.11
tpcds_q68/datafusion:vortex-file-compressed 34461075 32853519 1.05
tpcds_q69/datafusion:vortex-file-compressed 36181655 33944711 1.07
tpcds_q70/datafusion:vortex-file-compressed 102682830 93610389 1.10
tpcds_q71/datafusion:vortex-file-compressed 23083165 22369354 1.03
tpcds_q72/datafusion:vortex-file-compressed 🚨 2418308294 2067752330 1.17
tpcds_q73/datafusion:vortex-file-compressed 24774826 23332934 1.06
tpcds_q74/datafusion:vortex-file-compressed 82716368 77239064 1.07
tpcds_q75/datafusion:vortex-file-compressed 112756989 106651769 1.06
tpcds_q76/datafusion:vortex-file-compressed 🚨 31347419 27802301 1.13
tpcds_q77/datafusion:vortex-file-compressed 39281849 36059514 1.09
tpcds_q78/datafusion:vortex-file-compressed 117786949 108485969 1.09
tpcds_q79/datafusion:vortex-file-compressed 30842760 28979674 1.06
tpcds_q80/datafusion:vortex-file-compressed 95503728 88090540 1.08
tpcds_q81/datafusion:vortex-file-compressed 🚨 26544071 24030523 1.10
tpcds_q82/datafusion:vortex-file-compressed 21328265 20669977 1.03
tpcds_q83/datafusion:vortex-file-compressed 36653935 34743575 1.05
tpcds_q84/datafusion:vortex-file-compressed 12651939 11877989 1.07
tpcds_q85/datafusion:vortex-file-compressed 93311492 87049764 1.07
tpcds_q86/datafusion:vortex-file-compressed 16682502 15453564 1.08
tpcds_q87/datafusion:vortex-file-compressed 41822549 40356734 1.04
tpcds_q88/datafusion:vortex-file-compressed 58941551 54030468 1.09
tpcds_q89/datafusion:vortex-file-compressed 27156176 24783775 1.10
tpcds_q90/datafusion:vortex-file-compressed 14174792 12952828 1.09
tpcds_q91/datafusion:vortex-file-compressed 🚨 19995615 17818506 1.12
tpcds_q92/datafusion:vortex-file-compressed 🚨 17498709 15042115 1.16
tpcds_q93/datafusion:vortex-file-compressed 🚨 34918944 30757582 1.14
tpcds_q94/datafusion:vortex-file-compressed 22183803 20210153 1.10
tpcds_q95/datafusion:vortex-file-compressed 🚨 61758805 53469308 1.16
tpcds_q96/datafusion:vortex-file-compressed 🚨 14331580 12478223 1.15
tpcds_q97/datafusion:vortex-file-compressed 🚨 31620210 27941292 1.13
tpcds_q98/datafusion:vortex-file-compressed 25522186 23543940 1.08
tpcds_q99/datafusion:vortex-file-compressed 25170450 25261059 1.00
datafusion / parquet (1.071x ➖, 1↑ 29↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 25157755 23440585 1.07
tpcds_q02/datafusion:parquet 42245709 42091082 1.00
tpcds_q03/datafusion:parquet 14259952 13142100 1.09
tpcds_q04/datafusion:parquet 320576485 312566052 1.03
tpcds_q05/datafusion:parquet 46546063 47137001 0.99
tpcds_q06/datafusion:parquet 23698711 22373756 1.06
tpcds_q07/datafusion:parquet 🚨 84393339 76204554 1.11
tpcds_q08/datafusion:parquet 🚨 33402334 29045121 1.15
tpcds_q09/datafusion:parquet 🚨 46124584 37910670 1.22
tpcds_q10/datafusion:parquet 74841315 70798198 1.06
tpcds_q11/datafusion:parquet 158851707 149890638 1.06
tpcds_q12/datafusion:parquet 🚨 18852129 16639190 1.13
tpcds_q13/datafusion:parquet 80508203 75195335 1.07
tpcds_q14/datafusion:parquet 170136472 162283944 1.05
tpcds_q15/datafusion:parquet 21428172 22210562 0.96
tpcds_q16/datafusion:parquet 29348883 30909373 0.95
tpcds_q17/datafusion:parquet 63013865 62597787 1.01
tpcds_q18/datafusion:parquet 110728310 106052122 1.04
tpcds_q19/datafusion:parquet 25160668 24376910 1.03
tpcds_q20/datafusion:parquet 18061742 17764664 1.02
tpcds_q21/datafusion:parquet 19663462 18845948 1.04
tpcds_q22/datafusion:parquet 151366739 150495320 1.01
tpcds_q23/datafusion:parquet 🚨 174339113 151859551 1.15
tpcds_q24/datafusion:parquet 95582903 89691852 1.07
tpcds_q25/datafusion:parquet 65835863 62157820 1.06
tpcds_q26/datafusion:parquet 66600092 67339301 0.99
tpcds_q27/datafusion:parquet 🚨 152794205 136950555 1.12
tpcds_q28/datafusion:parquet 🚨 50313635 45649883 1.10
tpcds_q29/datafusion:parquet 68600838 64974582 1.06
tpcds_q30/datafusion:parquet 36114317 33317706 1.08
tpcds_q31/datafusion:parquet 71623015 67467614 1.06
tpcds_q32/datafusion:parquet 🚨 18574664 16073967 1.16
tpcds_q33/datafusion:parquet 29428961 27781323 1.06
tpcds_q34/datafusion:parquet 25444659 24563100 1.04
tpcds_q35/datafusion:parquet 🚨 81336178 73181328 1.11
tpcds_q36/datafusion:parquet 62960486 57485755 1.10
tpcds_q37/datafusion:parquet 20366863 19569031 1.04
tpcds_q38/datafusion:parquet 🚨 49044512 43293653 1.13
tpcds_q39/datafusion:parquet 🚨 84502255 73792516 1.15
tpcds_q40/datafusion:parquet 25141859 23738090 1.06
tpcds_q41/datafusion:parquet 🚨 16362506 14486194 1.13
tpcds_q42/datafusion:parquet 🚨 13425546 12155357 1.10
tpcds_q43/datafusion:parquet 17889739 17225200 1.04
tpcds_q44/datafusion:parquet 🚨 37188416 33807150 1.10
tpcds_q45/datafusion:parquet 30558661 29363154 1.04
tpcds_q46/datafusion:parquet 34152387 32625833 1.05
tpcds_q47/datafusion:parquet 140529962 128596108 1.09
tpcds_q48/datafusion:parquet 73249235 70200844 1.04
tpcds_q49/datafusion:parquet 58687938 56211476 1.04
tpcds_q50/datafusion:parquet 47871497 43608838 1.10
tpcds_q51/datafusion:parquet 93651647 86649376 1.08
tpcds_q52/datafusion:parquet 13196640 12252651 1.08
tpcds_q53/datafusion:parquet 18860330 17893131 1.05
tpcds_q54/datafusion:parquet 34425226 32497228 1.06
tpcds_q55/datafusion:parquet 🚨 12921381 11186604 1.16
tpcds_q56/datafusion:parquet 30297284 28350818 1.07
tpcds_q57/datafusion:parquet 99246633 99421888 1.00
tpcds_q58/datafusion:parquet 🚨 60494130 54124057 1.12
tpcds_q59/datafusion:parquet 66318123 65268227 1.02
tpcds_q60/datafusion:parquet 28861985 27854948 1.04
tpcds_q61/datafusion:parquet 46432285 43075058 1.08
tpcds_q62/datafusion:parquet 🚨 28002812 24409500 1.15
tpcds_q63/datafusion:parquet 19561572 18172988 1.08
tpcds_q64/datafusion:parquet 323658625 305092973 1.06
tpcds_q65/datafusion:parquet 🚨 41743001 37150242 1.12
tpcds_q66/datafusion:parquet 🚨 79197419 67941846 1.17
tpcds_q67/datafusion:parquet 159118337 150813876 1.06
tpcds_q68/datafusion:parquet 34345391 31726570 1.08
tpcds_q69/datafusion:parquet 70623130 66197294 1.07
tpcds_q70/datafusion:parquet 34618798 32795437 1.06
tpcds_q71/datafusion:parquet 24263368 22778279 1.07
tpcds_q72/datafusion:parquet 🚨 648990042 577409863 1.12
tpcds_q73/datafusion:parquet 🚨 24117594 21096843 1.14
tpcds_q74/datafusion:parquet 90741119 85857737 1.06
tpcds_q75/datafusion:parquet 119858493 110113537 1.09
tpcds_q76/datafusion:parquet 33270131 30612798 1.09
tpcds_q77/datafusion:parquet 🚨 43268085 38028392 1.14
tpcds_q78/datafusion:parquet 🚨 126578469 109629794 1.15
tpcds_q79/datafusion:parquet 🚨 30065990 26342026 1.14
tpcds_q80/datafusion:parquet 85370026 78196845 1.09
tpcds_q81/datafusion:parquet 32806531 30028278 1.09
tpcds_q82/datafusion:parquet 🚨 21044152 18947028 1.11
tpcds_q83/datafusion:parquet 43660831 42575493 1.03
tpcds_q84/datafusion:parquet 42593052 40359219 1.06
tpcds_q85/datafusion:parquet 🚨 160023005 144854013 1.10
tpcds_q86/datafusion:parquet 🚀 14830547 16844460 0.88
tpcds_q87/datafusion:parquet 48706142 44817669 1.09
tpcds_q88/datafusion:parquet 64832668 61982667 1.05
tpcds_q89/datafusion:parquet 24275761 22730362 1.07
tpcds_q90/datafusion:parquet 🚨 16463867 14928680 1.10
tpcds_q91/datafusion:parquet 62483826 60425001 1.03
tpcds_q92/datafusion:parquet 🚨 19627390 17065213 1.15
tpcds_q93/datafusion:parquet 🚨 35582230 30264434 1.18
tpcds_q94/datafusion:parquet 21812449 22200884 0.98
tpcds_q95/datafusion:parquet 62821506 60967982 1.03
tpcds_q96/datafusion:parquet 12868790 11787943 1.09
tpcds_q97/datafusion:parquet 30714949 31723429 0.97
tpcds_q98/datafusion:parquet 21994008 21249240 1.04
tpcds_q99/datafusion:parquet 26608806 25968104 1.02
duckdb / vortex-file-compressed (1.073x ➖, 1↑ 27↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 22968080 22768615 1.01
tpcds_q02/duckdb:vortex-file-compressed 🚨 24665975 22299453 1.11
tpcds_q03/duckdb:vortex-file-compressed 🚨 20872248 18335475 1.14
tpcds_q04/duckdb:vortex-file-compressed 92382785 94801476 0.97
tpcds_q05/duckdb:vortex-file-compressed 34426907 34265680 1.00
tpcds_q06/duckdb:vortex-file-compressed 36389869 33913025 1.07
tpcds_q07/duckdb:vortex-file-compressed 29773919 29679278 1.00
tpcds_q08/duckdb:vortex-file-compressed 🚨 29930368 26930363 1.11
tpcds_q09/duckdb:vortex-file-compressed 15860846 16484396 0.96
tpcds_q10/duckdb:vortex-file-compressed 41495713 40081503 1.04
tpcds_q11/duckdb:vortex-file-compressed 76478269 72721849 1.05
tpcds_q12/duckdb:vortex-file-compressed 14979788 14297394 1.05
tpcds_q13/duckdb:vortex-file-compressed 36080902 35783599 1.01
tpcds_q14/duckdb:vortex-file-compressed 110014199 103756200 1.06
tpcds_q15/duckdb:vortex-file-compressed 29150751 27280354 1.07
tpcds_q16/duckdb:vortex-file-compressed 24640787 23230464 1.06
tpcds_q17/duckdb:vortex-file-compressed 50415493 49624930 1.02
tpcds_q18/duckdb:vortex-file-compressed 🚨 48196222 39233108 1.23
tpcds_q19/duckdb:vortex-file-compressed 🚨 39830209 35980268 1.11
tpcds_q20/duckdb:vortex-file-compressed 🚨 16352727 14220013 1.15
tpcds_q21/duckdb:vortex-file-compressed 16675346 16306789 1.02
tpcds_q22/duckdb:vortex-file-compressed 🚨 80399263 70939965 1.13
tpcds_q23/duckdb:vortex-file-compressed 93068799 88486380 1.05
tpcds_q24/duckdb:vortex-file-compressed 49292869 45974089 1.07
tpcds_q25/duckdb:vortex-file-compressed 38482595 37228544 1.03
tpcds_q26/duckdb:vortex-file-compressed 🚨 20625191 18732704 1.10
tpcds_q27/duckdb:vortex-file-compressed 🚨 32595305 28501469 1.14
tpcds_q28/duckdb:vortex-file-compressed 🚨 13548068 12006571 1.13
tpcds_q29/duckdb:vortex-file-compressed 50261969 46938806 1.07
tpcds_q30/duckdb:vortex-file-compressed 29908095 27737277 1.08
tpcds_q31/duckdb:vortex-file-compressed 🚨 34351143 30904427 1.11
tpcds_q32/duckdb:vortex-file-compressed 🚨 15158056 13706648 1.11
tpcds_q33/duckdb:vortex-file-compressed 26915009 25991658 1.04
tpcds_q34/duckdb:vortex-file-compressed 29359123 27438897 1.07
tpcds_q35/duckdb:vortex-file-compressed 73578844 67533872 1.09
tpcds_q36/duckdb:vortex-file-compressed 27382988 25420468 1.08
tpcds_q37/duckdb:vortex-file-compressed 20859132 19736217 1.06
tpcds_q38/duckdb:vortex-file-compressed 39298609 36564027 1.07
tpcds_q39/duckdb:vortex-file-compressed 30277276 28807558 1.05
tpcds_q40/duckdb:vortex-file-compressed 19888450 18913037 1.05
tpcds_q41/duckdb:vortex-file-compressed 13032795 12519449 1.04
tpcds_q42/duckdb:vortex-file-compressed 16876037 15595440 1.08
tpcds_q43/duckdb:vortex-file-compressed 18995617 17833629 1.07
tpcds_q44/duckdb:vortex-file-compressed 22597044 22270422 1.01
tpcds_q45/duckdb:vortex-file-compressed 32588872 30356588 1.07
tpcds_q46/duckdb:vortex-file-compressed 🚀 32280027 37007746 0.87
tpcds_q47/duckdb:vortex-file-compressed 56296860 54717897 1.03
tpcds_q48/duckdb:vortex-file-compressed 35567039 32938121 1.08
tpcds_q49/duckdb:vortex-file-compressed 36723736 34692730 1.06
tpcds_q50/duckdb:vortex-file-compressed 28981658 27143235 1.07
tpcds_q51/duckdb:vortex-file-compressed 🚨 118676162 103950712 1.14
tpcds_q52/duckdb:vortex-file-compressed 16965268 15514732 1.09
tpcds_q53/duckdb:vortex-file-compressed 🚨 26523548 23522019 1.13
tpcds_q54/duckdb:vortex-file-compressed 🚨 34620236 29946139 1.16
tpcds_q55/duckdb:vortex-file-compressed 15615037 14664545 1.06
tpcds_q56/duckdb:vortex-file-compressed 29691377 28441094 1.04
tpcds_q57/duckdb:vortex-file-compressed 37329082 35728065 1.04
tpcds_q58/duckdb:vortex-file-compressed 🚨 34347322 30680368 1.12
tpcds_q59/duckdb:vortex-file-compressed 41373987 37691966 1.10
tpcds_q60/duckdb:vortex-file-compressed 30008170 28414480 1.06
tpcds_q61/duckdb:vortex-file-compressed 35396713 32329341 1.09
tpcds_q62/duckdb:vortex-file-compressed 16631842 15216651 1.09
tpcds_q63/duckdb:vortex-file-compressed 23253445 21824066 1.07
tpcds_q64/duckdb:vortex-file-compressed 109639023 103556301 1.06
tpcds_q65/duckdb:vortex-file-compressed 24795996 23439327 1.06
tpcds_q66/duckdb:vortex-file-compressed 32563154 29612539 1.10
tpcds_q67/duckdb:vortex-file-compressed 155236217 143153877 1.08
tpcds_q68/duckdb:vortex-file-compressed 35230948 33299914 1.06
tpcds_q69/duckdb:vortex-file-compressed 🚨 49207706 43783361 1.12
tpcds_q70/duckdb:vortex-file-compressed 🚨 36376253 32762129 1.11
tpcds_q71/duckdb:vortex-file-compressed 23710628 22498791 1.05
tpcds_q72/duckdb:vortex-file-compressed 163439463 154497973 1.06
tpcds_q73/duckdb:vortex-file-compressed 29352444 28085689 1.05
tpcds_q74/duckdb:vortex-file-compressed 51151486 46862943 1.09
tpcds_q75/duckdb:vortex-file-compressed 53451812 49293406 1.08
tpcds_q76/duckdb:vortex-file-compressed 22584945 21320995 1.06
tpcds_q77/duckdb:vortex-file-compressed 🚨 28278160 24542603 1.15
tpcds_q78/duckdb:vortex-file-compressed 72946515 69189311 1.05
tpcds_q79/duckdb:vortex-file-compressed 28971750 27228110 1.06
tpcds_q80/duckdb:vortex-file-compressed 50319273 47158943 1.07
tpcds_q81/duckdb:vortex-file-compressed 31397916 30574822 1.03
tpcds_q82/duckdb:vortex-file-compressed 47905241 45988267 1.04
tpcds_q83/duckdb:vortex-file-compressed 30428578 28020612 1.09
tpcds_q84/duckdb:vortex-file-compressed 18071433 17110977 1.06
tpcds_q85/duckdb:vortex-file-compressed 46573966 45041979 1.03
tpcds_q86/duckdb:vortex-file-compressed 17633424 16867603 1.05
tpcds_q87/duckdb:vortex-file-compressed 42305724 42536718 0.99
tpcds_q88/duckdb:vortex-file-compressed 🚨 65575774 58758341 1.12
tpcds_q89/duckdb:vortex-file-compressed 23600747 22237103 1.06
tpcds_q90/duckdb:vortex-file-compressed 🚨 12259004 11128453 1.10
tpcds_q91/duckdb:vortex-file-compressed 🚨 24979010 21688657 1.15
tpcds_q92/duckdb:vortex-file-compressed 🚨 19710770 17584762 1.12
tpcds_q93/duckdb:vortex-file-compressed 🚨 32069991 28215527 1.14
tpcds_q94/duckdb:vortex-file-compressed 🚨 25394345 22788424 1.11
tpcds_q95/duckdb:vortex-file-compressed 131654791 123279941 1.07
tpcds_q96/duckdb:vortex-file-compressed 15006233 14081989 1.07
tpcds_q97/duckdb:vortex-file-compressed 41400906 40558074 1.02
tpcds_q98/duckdb:vortex-file-compressed 🚨 22234884 19362422 1.15
tpcds_q99/duckdb:vortex-file-compressed 🚨 21975020 17853209 1.23
duckdb / parquet (1.055x ➖, 0↑ 14↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 31199502 29874201 1.04
tpcds_q02/duckdb:parquet 25014098 24630296 1.02
tpcds_q03/duckdb:parquet 13743535 12861132 1.07
tpcds_q04/duckdb:parquet 178305075 174890392 1.02
tpcds_q05/duckdb:parquet 🚨 36739545 33134819 1.11
tpcds_q06/duckdb:parquet 36010538 34716659 1.04
tpcds_q07/duckdb:parquet 25711511 24675766 1.04
tpcds_q08/duckdb:parquet 31908878 30404998 1.05
tpcds_q09/duckdb:parquet 47324553 45354315 1.04
tpcds_q10/duckdb:parquet 41449963 37937657 1.09
tpcds_q11/duckdb:parquet 95006234 92956139 1.02
tpcds_q12/duckdb:parquet 17692749 16523835 1.07
tpcds_q13/duckdb:parquet 36577721 36280137 1.01
tpcds_q14/duckdb:parquet 110197533 103202433 1.07
tpcds_q15/duckdb:parquet 🚨 35556682 31757079 1.12
tpcds_q16/duckdb:parquet 🚨 25527716 22944188 1.11
tpcds_q17/duckdb:parquet 42182025 39050881 1.08
tpcds_q18/duckdb:parquet 51665023 48325598 1.07
tpcds_q19/duckdb:parquet 🚨 35356850 32110931 1.10
tpcds_q20/duckdb:parquet 🚨 19139783 17267028 1.11
tpcds_q21/duckdb:parquet 13088141 12007382 1.09
tpcds_q22/duckdb:parquet 77518926 73244811 1.06
tpcds_q23/duckdb:parquet 🚨 90447169 81939962 1.10
tpcds_q24/duckdb:parquet 50126200 47368283 1.06
tpcds_q25/duckdb:parquet 38569903 36583839 1.05
tpcds_q26/duckdb:parquet 42722397 40896361 1.04
tpcds_q27/duckdb:parquet 56251277 52959125 1.06
tpcds_q28/duckdb:parquet 45865640 43759511 1.05
tpcds_q29/duckdb:parquet 42019842 39237793 1.07
tpcds_q30/duckdb:parquet 39419016 38152780 1.03
tpcds_q31/duckdb:parquet 🚨 30717309 26768660 1.15
tpcds_q32/duckdb:parquet 13539805 12965984 1.04
tpcds_q33/duckdb:parquet 25734095 23957761 1.07
tpcds_q34/duckdb:parquet 23734764 23823910 1.00
tpcds_q35/duckdb:parquet 65765012 62271548 1.06
tpcds_q36/duckdb:parquet 22799645 23072978 0.99
tpcds_q37/duckdb:parquet 15292764 15364074 1.00
tpcds_q38/duckdb:parquet 38607117 36862587 1.05
tpcds_q39/duckdb:parquet 33292543 32653207 1.02
tpcds_q40/duckdb:parquet 21103758 19920884 1.06
tpcds_q41/duckdb:parquet 9459758 9142568 1.03
tpcds_q42/duckdb:parquet 13378476 12537354 1.07
tpcds_q43/duckdb:parquet 🚨 19713435 17490702 1.13
tpcds_q44/duckdb:parquet 27225846 26674344 1.02
tpcds_q45/duckdb:parquet 🚨 33521403 29442375 1.14
tpcds_q46/duckdb:parquet 52665866 48293297 1.09
tpcds_q47/duckdb:parquet 52960275 50416753 1.05
tpcds_q48/duckdb:parquet 33708872 32890919 1.02
tpcds_q49/duckdb:parquet 30509340 29411512 1.04
tpcds_q50/duckdb:parquet 27427485 26330995 1.04
tpcds_q51/duckdb:parquet 109074730 108786760 1.00
tpcds_q52/duckdb:parquet 13054480 13232591 0.99
tpcds_q53/duckdb:parquet 17790334 17406879 1.02
tpcds_q54/duckdb:parquet 31297706 29958852 1.04
tpcds_q55/duckdb:parquet 13797190 12868226 1.07
tpcds_q56/duckdb:parquet 25053374 24929370 1.00
tpcds_q57/duckdb:parquet 40698788 38339840 1.06
tpcds_q58/duckdb:parquet 27222391 25914556 1.05
tpcds_q59/duckdb:parquet 37623279 36778885 1.02
tpcds_q60/duckdb:parquet 27311177 25280183 1.08
tpcds_q61/duckdb:parquet 36028032 34663990 1.04
tpcds_q62/duckdb:parquet 13680209 12840944 1.07
tpcds_q63/duckdb:parquet 🚨 17256325 15612228 1.11
tpcds_q64/duckdb:parquet 🚨 84358387 76434683 1.10
tpcds_q65/duckdb:parquet 23653246 22704994 1.04
tpcds_q66/duckdb:parquet 31117454 32024103 0.97
tpcds_q67/duckdb:parquet 150515287 137471878 1.09
tpcds_q68/duckdb:parquet 41114939 38827770 1.06
tpcds_q69/duckdb:parquet 40726204 38897308 1.05
tpcds_q70/duckdb:parquet 24000020 22964313 1.05
tpcds_q71/duckdb:parquet 23843439 22872159 1.04
tpcds_q72/duckdb:parquet 171322190 168364588 1.02
tpcds_q73/duckdb:parquet 20941467 20693102 1.01
tpcds_q74/duckdb:parquet 134640917 127618883 1.06
tpcds_q75/duckdb:parquet 62065859 58887209 1.05
tpcds_q76/duckdb:parquet 22486678 22817758 0.99
tpcds_q77/duckdb:parquet 27609468 25551523 1.08
tpcds_q78/duckdb:parquet 82346371 77769850 1.06
tpcds_q79/duckdb:parquet 31984975 30657965 1.04
tpcds_q80/duckdb:parquet 47847938 44331538 1.08
tpcds_q81/duckdb:parquet 36999749 35790127 1.03
tpcds_q82/duckdb:parquet 🚨 18849023 17124852 1.10
tpcds_q83/duckdb:parquet 19474842 18561157 1.05
tpcds_q84/duckdb:parquet 21747261 20498958 1.06
tpcds_q85/duckdb:parquet 43969260 43116480 1.02
tpcds_q86/duckdb:parquet 14886862 13774517 1.08
tpcds_q87/duckdb:parquet 41783471 40717372 1.03
tpcds_q88/duckdb:parquet 56976467 54500811 1.05
tpcds_q89/duckdb:parquet 19729569 19057844 1.04
tpcds_q90/duckdb:parquet 9337181 8567098 1.09
tpcds_q91/duckdb:parquet 26699115 24795227 1.08
tpcds_q92/duckdb:parquet 🚨 14334974 13015290 1.10
tpcds_q93/duckdb:parquet 35042232 32168688 1.09
tpcds_q94/duckdb:parquet 19401136 18577415 1.04
tpcds_q95/duckdb:parquet 🚨 140937389 126990241 1.11
tpcds_q96/duckdb:parquet 11121874 10955664 1.02
tpcds_q97/duckdb:parquet 42027887 40400946 1.04
tpcds_q98/duckdb:parquet 23306997 21844583 1.07
tpcds_q99/duckdb:parquet 21460126 20335997 1.06
File Size Changes (25 files changed, -43.5% overall, 0↑ 25↓)
File Scale Format Base HEAD Change %
call_center.vortex 1.0 vortex-compact 47.43 KB 0 B 47.43 KB -100.0%
catalog_page.vortex 1.0 vortex-compact 362.44 KB 0 B 362.44 KB -100.0%
catalog_returns.vortex 1.0 vortex-compact 6.04 MB 0 B 6.04 MB -100.0%
catalog_sales.vortex 1.0 vortex-compact 59.49 MB 0 B 59.49 MB -100.0%
customer.vortex 1.0 vortex-compact 3.29 MB 0 B 3.29 MB -100.0%
customer_address.vortex 1.0 vortex-compact 638.84 KB 0 B 638.84 KB -100.0%
customer_demographics.vortex 1.0 vortex-compact 424.18 KB 0 B 424.18 KB -100.0%
date_dim.vortex 1.0 vortex-compact 140.28 KB 0 B 140.28 KB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
household_demographics.vortex 1.0 vortex-compact 10.29 KB 0 B 10.29 KB -100.0%
income_band.vortex 1.0 vortex-compact 5.56 KB 0 B 5.56 KB -100.0%
inventory.vortex 1.0 vortex-compact 16.07 MB 0 B 16.07 MB -100.0%
item.vortex 1.0 vortex-compact 1000.32 KB 0 B 1000.32 KB -100.0%
promotion.vortex 1.0 vortex-compact 50.31 KB 0 B 50.31 KB -100.0%
reason.vortex 1.0 vortex-compact 5.96 KB 0 B 5.96 KB -100.0%
ship_mode.vortex 1.0 vortex-compact 10.73 KB 0 B 10.73 KB -100.0%
store.vortex 1.0 vortex-compact 43.22 KB 0 B 43.22 KB -100.0%
store_returns.vortex 1.0 vortex-compact 9.36 MB 0 B 9.36 MB -100.0%
store_sales.vortex 1.0 vortex-compact 78.12 MB 0 B 78.12 MB -100.0%
time_dim.vortex 1.0 vortex-compact 96.59 KB 0 B 96.59 KB -100.0%
warehouse.vortex 1.0 vortex-compact 22.14 KB 0 B 22.14 KB -100.0%
web_page.vortex 1.0 vortex-compact 25.01 KB 0 B 25.01 KB -100.0%
web_returns.vortex 1.0 vortex-compact 3.00 MB 0 B 3.00 MB -100.0%
web_sales.vortex 1.0 vortex-compact 29.45 MB 0 B 29.45 MB -100.0%
web_site.vortex 1.0 vortex-compact 42.19 KB 0 B 42.19 KB -100.0%

Totals:

  • vortex-compact: 207.94 MB → 0 B (-100.0%)
  • vortex-file-compressed: 269.98 MB → 269.98 MB (0.0%)

@mhk197
mhk197 force-pushed the mk/enable-list-layout-bench branch from 862d595 to 6ce102b Compare July 16, 2026 20:52
@mhk197 mhk197 added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 16, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 16, 2026
@codspeed-hq

codspeed-hq Bot commented Jul 16, 2026 •
edited
Loading

Copy link
Copy Markdown

Merging this PR will not alter performance

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

✅ 1892 untouched benchmarks
⏩ 3 skipped benchmarks1

Comparing mk/enable-list-layout-bench (9182af3) with develop (8c1dfc7)

Open in CodSpeed

Footnotes

  1. 3 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@github-actions

github-actions Bot commented Jul 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -4.6%
Engines: DataFusion No clear signal (-5.6%, environment too noisy confidence) · DuckDB No clear signal (-3.6%, low confidence)
Vortex (geomean): 1.034x ➖
Parquet (geomean): 1.084x ➖
Shifts: Parquet (control) +8.4% · Median polish +2.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.057x ➖, 0↑ 1↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 62973003 30338574 2.08
fineweb_q01/datafusion:vortex-file-compressed 530045841 495671189 1.07
fineweb_q02/datafusion:vortex-file-compressed 447146693 455173007 0.98
fineweb_q03/datafusion:vortex-file-compressed 1106920404 1258401260 0.88
fineweb_q04/datafusion:vortex-file-compressed 1135606235 1149115730 0.99
fineweb_q05/datafusion:vortex-file-compressed 1067223449 1165715384 0.92
fineweb_q06/datafusion:vortex-file-compressed 1265242346 1337063533 0.95
fineweb_q07/datafusion:vortex-file-compressed 1153216329 1142706470 1.01
fineweb_q08/datafusion:vortex-file-compressed 478782192 481848565 0.99
datafusion / parquet (1.120x ➖, 0↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1358739523 1119111439 1.21
fineweb_q01/datafusion:parquet 1915882844 1611322225 1.19
fineweb_q02/datafusion:parquet 1956371699 1686013163 1.16
fineweb_q03/datafusion:parquet 1778396388 1882783983 0.94
fineweb_q04/datafusion:parquet 1907212901 1725438609 1.11
fineweb_q05/datafusion:parquet 2004862218 1672525806 1.20
fineweb_q06/datafusion:parquet 2010047425 1784594029 1.13
fineweb_q07/datafusion:parquet 1866262249 1729081315 1.08
fineweb_q08/datafusion:parquet 1812360415 1671321954 1.08
duckdb / vortex-file-compressed (1.011x ➖, 0↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 85607343 74141155 1.15
fineweb_q01/duckdb:vortex-file-compressed 549790962 530735610 1.04
fineweb_q02/duckdb:vortex-file-compressed 453586086 516121671 0.88
fineweb_q03/duckdb:vortex-file-compressed 1226339251 1255254960 0.98
fineweb_q04/duckdb:vortex-file-compressed 1297475663 1312652565 0.99
fineweb_q05/duckdb:vortex-file-compressed 1277308024 1197149608 1.07
fineweb_q06/duckdb:vortex-file-compressed 1410529208 1372236163 1.03
fineweb_q07/duckdb:vortex-file-compressed 1214482938 1248814352 0.97
fineweb_q08/duckdb:vortex-file-compressed 540567587 530137245 1.02
duckdb / parquet (1.049x ➖, 0↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1073199208 1046810447 1.03
fineweb_q01/duckdb:parquet 1387431241 1280346725 1.08
fineweb_q02/duckdb:parquet 1379610025 1302301335 1.06
fineweb_q03/duckdb:parquet 3659957981 3479712323 1.05
fineweb_q04/duckdb:parquet 1830591082 1833370177 1.00
fineweb_q05/duckdb:parquet 2179369482 2096684580 1.04
fineweb_q06/duckdb:parquet 4283077694 4233501098 1.01
fineweb_q07/duckdb:parquet 2557324921 2517101544 1.02
fineweb_q08/duckdb:parquet 1200801556 1030526791 1.17

@github-actions

github-actions Bot commented Jul 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+2.1%, low confidence)
Vortex (geomean): 0.954x ➖
Parquet (geomean): 0.947x ➖
Shifts: Parquet (control) -5.3% · Median polish -5.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.939x ➖, 3↑ 1↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-file-compressed 🚨 525166730 434945581 1.21
clickbench-sorted_q24/datafusion:vortex-file-compressed 🚀 20270188 25094903 0.81
clickbench-sorted_q26/datafusion:vortex-file-compressed 21671982 23111690 0.94
clickbench-sorted_q36/datafusion:vortex-file-compressed 🚀 55924401 62514054 0.89
clickbench-sorted_q37/datafusion:vortex-file-compressed 41541667 45978952 0.90
clickbench-sorted_q38/datafusion:vortex-file-compressed 40999276 44839506 0.91
clickbench-sorted_q39/datafusion:vortex-file-compressed 112151608 116977660 0.96
clickbench-sorted_q40/datafusion:vortex-file-compressed 🚀 19940759 22585415 0.88
clickbench-sorted_q41/datafusion:vortex-file-compressed 20273911 20502303 0.99
clickbench-sorted_q42/datafusion:vortex-file-compressed 14090073 15019116 0.94
datafusion / parquet (0.943x ➖, 0↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet 4697061067 5010702051 0.94
clickbench-sorted_q24/datafusion:parquet 29215615 29554275 0.99
clickbench-sorted_q26/datafusion:parquet 27296139 30208376 0.90
clickbench-sorted_q36/datafusion:parquet 178590962 195978202 0.91
clickbench-sorted_q37/datafusion:parquet 109658035 113264230 0.97
clickbench-sorted_q38/datafusion:parquet 168365549 186033382 0.91
clickbench-sorted_q39/datafusion:parquet 293776906 305700862 0.96
clickbench-sorted_q40/datafusion:parquet 62711712 66386613 0.94
clickbench-sorted_q41/datafusion:parquet 57771961 61936864 0.93
clickbench-sorted_q42/datafusion:parquet 31924068 32625291 0.98
duckdb / vortex-file-compressed (0.970x ➖, 2↑ 2↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-file-compressed 🚀 161170463 198418962 0.81
clickbench-sorted_q24/duckdb:vortex-file-compressed 🚨 32484554 26844030 1.21
clickbench-sorted_q26/duckdb:vortex-file-compressed 🚨 50627098 40503424 1.25
clickbench-sorted_q36/duckdb:vortex-file-compressed 57123653 60950864 0.94
clickbench-sorted_q37/duckdb:vortex-file-compressed 49180122 49639133 0.99
clickbench-sorted_q38/duckdb:vortex-file-compressed 50998971 52454146 0.97
clickbench-sorted_q39/duckdb:vortex-file-compressed 108101304 117868812 0.92
clickbench-sorted_q40/duckdb:vortex-file-compressed 29280930 30045942 0.97
clickbench-sorted_q41/duckdb:vortex-file-compressed 27900582 30635320 0.91
clickbench-sorted_q42/duckdb:vortex-file-compressed 🚀 23143597 28216751 0.82
duckdb / parquet (0.951x ➖, 1↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet 🚀 195613886 222373697 0.88
clickbench-sorted_q24/duckdb:parquet 28619198 29984168 0.95
clickbench-sorted_q26/duckdb:parquet 23311179 24248583 0.96
clickbench-sorted_q36/duckdb:parquet 109235121 115007815 0.95
clickbench-sorted_q37/duckdb:parquet 94115657 94732203 0.99
clickbench-sorted_q38/duckdb:parquet 96294438 103067508 0.93
clickbench-sorted_q39/duckdb:parquet 178064862 189728567 0.94
clickbench-sorted_q40/duckdb:parquet 42122568 42289026 1.00
clickbench-sorted_q41/duckdb:parquet 41246506 42753939 0.96
clickbench-sorted_q42/duckdb:parquet 29604230 31529015 0.94
File Size Changes (201 files changed, -42.8% overall, 50↑ 151↓)
File Scale Format Base HEAD Change %
hits_034.vortex 1.0 vortex-file-compressed 182.00 MB 184.08 MB +2.08 MB +1.1%
hits_060.vortex 1.0 vortex-file-compressed 193.22 MB 195.18 MB +1.96 MB +1.0%
hits_027.vortex 1.0 vortex-file-compressed 190.02 MB 191.78 MB +1.75 MB +0.9%
hits_003.vortex 1.0 vortex-file-compressed 136.55 MB 137.45 MB +926.26 KB +0.7%
hits_008.vortex 1.0 vortex-file-compressed 140.20 MB 140.90 MB +716.81 KB +0.5%
hits_000.vortex 1.0 vortex-file-compressed 131.56 MB 132.11 MB +561.66 KB +0.4%
hits_062.vortex 1.0 vortex-file-compressed 170.86 MB 171.58 MB +729.13 KB +0.4%
hits_014.vortex 1.0 vortex-file-compressed 172.09 MB 172.78 MB +704.17 KB +0.4%
hits_023.vortex 1.0 vortex-file-compressed 195.57 MB 196.32 MB +768.38 KB +0.4%
hits_017.vortex 1.0 vortex-file-compressed 146.81 MB 147.35 MB +557.82 KB +0.4%
hits_025.vortex 1.0 vortex-file-compressed 171.87 MB 172.44 MB +582.22 KB +0.3%
hits_026.vortex 1.0 vortex-file-compressed 131.29 MB 131.63 MB +351.71 KB +0.3%
hits_015.vortex 1.0 vortex-file-compressed 131.07 MB 131.40 MB +339.23 KB +0.3%
hits_029.vortex 1.0 vortex-file-compressed 199.87 MB 200.34 MB +486.63 KB +0.2%
hits_016.vortex 1.0 vortex-file-compressed 180.18 MB 180.56 MB +390.89 KB +0.2%
hits_057.vortex 1.0 vortex-file-compressed 159.93 MB 160.22 MB +301.73 KB +0.2%
hits_078.vortex 1.0 vortex-file-compressed 130.88 MB 131.10 MB +231.40 KB +0.2%
hits_041.vortex 1.0 vortex-file-compressed 131.21 MB 131.41 MB +203.69 KB +0.2%
hits_064.vortex 1.0 vortex-file-compressed 190.99 MB 191.22 MB +242.52 KB +0.1%
hits_031.vortex 1.0 vortex-file-compressed 159.59 MB 159.77 MB +178.99 KB +0.1%
hits_037.vortex 1.0 vortex-file-compressed 177.32 MB 177.51 MB +197.95 KB +0.1%
hits_019.vortex 1.0 vortex-file-compressed 140.85 MB 141.00 MB +155.00 KB +0.1%
hits_058.vortex 1.0 vortex-file-compressed 155.08 MB 155.24 MB +163.06 KB +0.1%
hits_099.vortex 1.0 vortex-file-compressed 171.30 MB 171.45 MB +151.79 KB +0.1%
hits_005.vortex 1.0 vortex-file-compressed 167.78 MB 167.92 MB +144.96 KB +0.1%
hits_045.vortex 1.0 vortex-file-compressed 140.10 MB 140.19 MB +89.10 KB +0.1%
hits_084.vortex 1.0 vortex-file-compressed 154.47 MB 154.56 MB +93.83 KB +0.1%
hits_085.vortex 1.0 vortex-file-compressed 199.68 MB 199.79 MB +114.02 KB +0.1%
hits_010.vortex 1.0 vortex-file-compressed 169.08 MB 169.17 MB +86.34 KB +0.0%
hits_059.vortex 1.0 vortex-file-compressed 199.03 MB 199.12 MB +94.41 KB +0.0%
hits_056.vortex 1.0 vortex-file-compressed 135.72 MB 135.78 MB +62.12 KB +0.0%
hits_067.vortex 1.0 vortex-file-compressed 131.70 MB 131.75 MB +58.22 KB +0.0%
hits_069.vortex 1.0 vortex-file-compressed 142.23 MB 142.29 MB +59.79 KB +0.0%
hits_095.vortex 1.0 vortex-file-compressed 154.41 MB 154.47 MB +64.37 KB +0.0%
hits_073.vortex 1.0 vortex-file-compressed 172.78 MB 172.85 MB +70.05 KB +0.0%
hits_090.vortex 1.0 vortex-file-compressed 192.44 MB 192.52 MB +77.44 KB +0.0%
hits_001.vortex 1.0 vortex-file-compressed 189.23 MB 189.30 MB +69.33 KB +0.0%
hits_053.vortex 1.0 vortex-file-compressed 189.91 MB 189.98 MB +65.76 KB +0.0%
hits_083.vortex 1.0 vortex-file-compressed 157.15 MB 157.20 MB +51.61 KB +0.0%
hits_079.vortex 1.0 vortex-file-compressed 181.03 MB 181.08 MB +59.02 KB +0.0%
hits_093.vortex 1.0 vortex-file-compressed 131.74 MB 131.77 MB +29.95 KB +0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.84 MB 126.86 MB +25.62 KB +0.0%
hits_061.vortex 1.0 vortex-file-compressed 160.82 MB 160.85 MB +31.17 KB +0.0%
hits_022.vortex 1.0 vortex-file-compressed 199.01 MB 199.04 MB +29.22 KB +0.0%
hits_050.vortex 1.0 vortex-file-compressed 161.11 MB 161.13 MB +21.87 KB +0.0%
hits_086.vortex 1.0 vortex-file-compressed 192.12 MB 192.14 MB +22.33 KB +0.0%
hits_075.vortex 1.0 vortex-file-compressed 189.62 MB 189.64 MB +20.15 KB +0.0%
hits_070.vortex 1.0 vortex-file-compressed 199.97 MB 199.99 MB +21.12 KB +0.0%
hits_076.vortex 1.0 vortex-file-compressed 161.05 MB 161.05 MB +4.43 KB +0.0%
hits_032.vortex 1.0 vortex-file-compressed 154.80 MB 154.81 MB +3.01 KB +0.0%
hits_004.vortex 1.0 vortex-file-compressed 131.59 MB 131.58 MB 6.03 KB -0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.06 MB 147.05 MB 10.53 KB -0.0%
hits_009.vortex 1.0 vortex-file-compressed 101.32 MB 101.30 MB 12.00 KB -0.0%
hits_074.vortex 1.0 vortex-file-compressed 199.19 MB 199.16 MB 26.36 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.40 MB 126.38 MB 20.81 KB -0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.54 MB 126.52 MB 21.71 KB -0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.12 MB 161.09 MB 27.79 KB -0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.92 MB 131.90 MB 25.49 KB -0.0%
hits_012.vortex 1.0 vortex-file-compressed 190.98 MB 190.94 MB 43.48 KB -0.0%
hits_028.vortex 1.0 vortex-file-compressed 151.92 MB 151.88 MB 36.62 KB -0.0%
hits_040.vortex 1.0 vortex-file-compressed 143.53 MB 143.49 MB 39.84 KB -0.0%
hits_077.vortex 1.0 vortex-file-compressed 172.43 MB 172.39 MB 49.12 KB -0.0%
hits_094.vortex 1.0 vortex-file-compressed 158.58 MB 158.53 MB 50.50 KB -0.0%
hits_051.vortex 1.0 vortex-file-compressed 172.54 MB 172.48 MB 60.70 KB -0.0%
hits_089.vortex 1.0 vortex-file-compressed 131.46 MB 131.41 MB 51.25 KB -0.0%
hits_020.vortex 1.0 vortex-file-compressed 160.22 MB 160.15 MB 72.95 KB -0.0%
hits_021.vortex 1.0 vortex-file-compressed 154.40 MB 154.33 MB 81.10 KB -0.1%
hits_013.vortex 1.0 vortex-file-compressed 161.31 MB 161.21 MB 100.51 KB -0.1%
hits_097.vortex 1.0 vortex-file-compressed 192.95 MB 192.82 MB 134.78 KB -0.1%
hits_033.vortex 1.0 vortex-file-compressed 200.17 MB 200.01 MB 165.25 KB -0.1%
hits_082.vortex 1.0 vortex-file-compressed 140.01 MB 139.90 MB 119.09 KB -0.1%
hits_007.vortex 1.0 vortex-file-compressed 200.14 MB 199.97 MB 177.24 KB -0.1%
hits_047.vortex 1.0 vortex-file-compressed 154.49 MB 154.35 MB 146.87 KB -0.1%
hits_063.vortex 1.0 vortex-file-compressed 131.76 MB 131.63 MB 130.91 KB -0.1%
hits_018.vortex 1.0 vortex-file-compressed 198.87 MB 198.67 MB 202.07 KB -0.1%
hits_054.vortex 1.0 vortex-file-compressed 147.13 MB 146.98 MB 153.23 KB -0.1%
hits_011.vortex 1.0 vortex-file-compressed 199.49 MB 199.27 MB 226.19 KB -0.1%
hits_038.vortex 1.0 vortex-file-compressed 190.27 MB 190.05 MB 226.81 KB -0.1%
hits_098.vortex 1.0 vortex-file-compressed 137.73 MB 137.56 MB 168.96 KB -0.1%
hits_068.vortex 1.0 vortex-file-compressed 160.81 MB 160.60 MB 207.46 KB -0.1%
hits_081.vortex 1.0 vortex-file-compressed 200.09 MB 199.82 MB 267.69 KB -0.1%
hits_072.vortex 1.0 vortex-file-compressed 102.56 MB 102.36 MB 201.09 KB -0.2%
hits_048.vortex 1.0 vortex-file-compressed 200.07 MB 199.59 MB 487.21 KB -0.2%
hits_042.vortex 1.0 vortex-file-compressed 201.65 MB 201.16 MB 503.38 KB -0.2%
hits_036.vortex 1.0 vortex-file-compressed 172.63 MB 172.18 MB 460.67 KB -0.3%
hits_002.vortex 1.0 vortex-file-compressed 161.56 MB 161.13 MB 443.20 KB -0.3%
hits_088.vortex 1.0 vortex-file-compressed 172.53 MB 172.04 MB 508.29 KB -0.3%
hits_035.vortex 1.0 vortex-file-compressed 102.89 MB 102.57 MB 329.35 KB -0.3%
hits_024.vortex 1.0 vortex-file-compressed 161.16 MB 160.63 MB 551.22 KB -0.3%
hits_096.vortex 1.0 vortex-file-compressed 199.35 MB 198.62 MB 746.85 KB -0.4%
hits_065.vortex 1.0 vortex-file-compressed 161.81 MB 161.19 MB 636.45 KB -0.4%
hits_046.vortex 1.0 vortex-file-compressed 101.75 MB 101.28 MB 483.23 KB -0.5%
hits_052.vortex 1.0 vortex-file-compressed 131.46 MB 130.84 MB 634.69 KB -0.5%
hits_044.vortex 1.0 vortex-file-compressed 200.03 MB 199.07 MB 980.39 KB -0.5%
hits_071.vortex 1.0 vortex-file-compressed 141.32 MB 140.60 MB 733.02 KB -0.5%
hits_066.vortex 1.0 vortex-file-compressed 164.68 MB 163.54 MB 1.14 MB -0.7%
hits_092.vortex 1.0 vortex-file-compressed 199.67 MB 198.29 MB 1.38 MB -0.7%
hits_055.vortex 1.0 vortex-file-compressed 199.87 MB 198.48 MB 1.39 MB -0.7%
hits_087.vortex 1.0 vortex-file-compressed 161.08 MB 159.72 MB 1.36 MB -0.8%
hits_049.vortex 1.0 vortex-file-compressed 195.13 MB 191.55 MB 3.58 MB -1.8%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_000.vortex 1.0 vortex-compact 99.17 MB 0 B 99.17 MB -100.0%
hits_001.vortex 1.0 vortex-compact 137.72 MB 0 B 137.72 MB -100.0%
hits_002.vortex 1.0 vortex-compact 125.68 MB 0 B 125.68 MB -100.0%
hits_003.vortex 1.0 vortex-compact 104.60 MB 0 B 104.60 MB -100.0%
hits_004.vortex 1.0 vortex-compact 98.50 MB 0 B 98.50 MB -100.0%
hits_005.vortex 1.0 vortex-compact 116.32 MB 0 B 116.32 MB -100.0%
hits_006.vortex 1.0 vortex-compact 96.07 MB 0 B 96.07 MB -100.0%
hits_007.vortex 1.0 vortex-compact 153.08 MB 0 B 153.08 MB -100.0%
hits_008.vortex 1.0 vortex-compact 106.15 MB 0 B 106.15 MB -100.0%
hits_009.vortex 1.0 vortex-compact 75.23 MB 0 B 75.23 MB -100.0%
hits_010.vortex 1.0 vortex-compact 123.04 MB 0 B 123.04 MB -100.0%
hits_011.vortex 1.0 vortex-compact 152.89 MB 0 B 152.89 MB -100.0%
hits_012.vortex 1.0 vortex-compact 140.08 MB 0 B 140.08 MB -100.0%
hits_013.vortex 1.0 vortex-compact 123.98 MB 0 B 123.98 MB -100.0%
hits_014.vortex 1.0 vortex-compact 134.40 MB 0 B 134.40 MB -100.0%
hits_015.vortex 1.0 vortex-compact 98.69 MB 0 B 98.69 MB -100.0%
hits_016.vortex 1.0 vortex-compact 127.64 MB 0 B 127.64 MB -100.0%
hits_017.vortex 1.0 vortex-compact 111.72 MB 0 B 111.72 MB -100.0%
hits_018.vortex 1.0 vortex-compact 153.04 MB 0 B 153.04 MB -100.0%
hits_019.vortex 1.0 vortex-compact 106.17 MB 0 B 106.17 MB -100.0%
hits_020.vortex 1.0 vortex-compact 112.19 MB 0 B 112.19 MB -100.0%
hits_021.vortex 1.0 vortex-compact 110.65 MB 0 B 110.65 MB -100.0%
hits_022.vortex 1.0 vortex-compact 153.09 MB 0 B 153.09 MB -100.0%
hits_023.vortex 1.0 vortex-compact 142.63 MB 0 B 142.63 MB -100.0%
hits_024.vortex 1.0 vortex-compact 125.26 MB 0 B 125.26 MB -100.0%
hits_025.vortex 1.0 vortex-compact 133.44 MB 0 B 133.44 MB -100.0%
hits_026.vortex 1.0 vortex-compact 99.21 MB 0 B 99.21 MB -100.0%
hits_027.vortex 1.0 vortex-compact 139.34 MB 0 B 139.34 MB -100.0%
hits_028.vortex 1.0 vortex-compact 115.73 MB 0 B 115.73 MB -100.0%
hits_029.vortex 1.0 vortex-compact 153.34 MB 0 B 153.34 MB -100.0%
hits_030.vortex 1.0 vortex-compact 98.82 MB 0 B 98.82 MB -100.0%
hits_031.vortex 1.0 vortex-compact 111.21 MB 0 B 111.21 MB -100.0%
hits_032.vortex 1.0 vortex-compact 110.61 MB 0 B 110.61 MB -100.0%
hits_033.vortex 1.0 vortex-compact 152.86 MB 0 B 152.86 MB -100.0%
hits_034.vortex 1.0 vortex-compact 133.35 MB 0 B 133.35 MB -100.0%
hits_035.vortex 1.0 vortex-compact 75.94 MB 0 B 75.94 MB -100.0%
hits_036.vortex 1.0 vortex-compact 133.40 MB 0 B 133.40 MB -100.0%
hits_037.vortex 1.0 vortex-compact 132.06 MB 0 B 132.06 MB -100.0%
hits_038.vortex 1.0 vortex-compact 139.54 MB 0 B 139.54 MB -100.0%
hits_039.vortex 1.0 vortex-compact 124.99 MB 0 B 124.99 MB -100.0%
hits_040.vortex 1.0 vortex-compact 110.01 MB 0 B 110.01 MB -100.0%
hits_041.vortex 1.0 vortex-compact 98.65 MB 0 B 98.65 MB -100.0%
hits_042.vortex 1.0 vortex-compact 136.53 MB 0 B 136.53 MB -100.0%
hits_043.vortex 1.0 vortex-compact 94.54 MB 0 B 94.54 MB -100.0%
hits_044.vortex 1.0 vortex-compact 153.70 MB 0 B 153.70 MB -100.0%
hits_045.vortex 1.0 vortex-compact 106.23 MB 0 B 106.23 MB -100.0%
hits_046.vortex 1.0 vortex-compact 75.00 MB 0 B 75.00 MB -100.0%
hits_047.vortex 1.0 vortex-compact 110.47 MB 0 B 110.47 MB -100.0%
hits_048.vortex 1.0 vortex-compact 153.44 MB 0 B 153.44 MB -100.0%
hits_049.vortex 1.0 vortex-compact 139.43 MB 0 B 139.43 MB -100.0%
hits_050.vortex 1.0 vortex-compact 126.14 MB 0 B 126.14 MB -100.0%
hits_051.vortex 1.0 vortex-compact 134.01 MB 0 B 134.01 MB -100.0%
hits_052.vortex 1.0 vortex-compact 98.97 MB 0 B 98.97 MB -100.0%
hits_053.vortex 1.0 vortex-compact 138.53 MB 0 B 138.53 MB -100.0%
hits_054.vortex 1.0 vortex-compact 112.05 MB 0 B 112.05 MB -100.0%
hits_055.vortex 1.0 vortex-compact 153.20 MB 0 B 153.20 MB -100.0%
hits_056.vortex 1.0 vortex-compact 101.30 MB 0 B 101.30 MB -100.0%
hits_057.vortex 1.0 vortex-compact 111.90 MB 0 B 111.90 MB -100.0%
hits_058.vortex 1.0 vortex-compact 111.08 MB 0 B 111.08 MB -100.0%
hits_059.vortex 1.0 vortex-compact 152.86 MB 0 B 152.86 MB -100.0%
hits_060.vortex 1.0 vortex-compact 141.27 MB 0 B 141.27 MB -100.0%
hits_061.vortex 1.0 vortex-compact 124.30 MB 0 B 124.30 MB -100.0%
hits_062.vortex 1.0 vortex-compact 132.79 MB 0 B 132.79 MB -100.0%
hits_063.vortex 1.0 vortex-compact 98.78 MB 0 B 98.78 MB -100.0%
hits_064.vortex 1.0 vortex-compact 140.57 MB 0 B 140.57 MB -100.0%
hits_065.vortex 1.0 vortex-compact 125.18 MB 0 B 125.18 MB -100.0%
hits_066.vortex 1.0 vortex-compact 117.57 MB 0 B 117.57 MB -100.0%
hits_067.vortex 1.0 vortex-compact 98.63 MB 0 B 98.63 MB -100.0%
hits_068.vortex 1.0 vortex-compact 112.45 MB 0 B 112.45 MB -100.0%
hits_069.vortex 1.0 vortex-compact 99.69 MB 0 B 99.69 MB -100.0%
hits_070.vortex 1.0 vortex-compact 153.35 MB 0 B 153.35 MB -100.0%
hits_071.vortex 1.0 vortex-compact 106.26 MB 0 B 106.26 MB -100.0%
hits_072.vortex 1.0 vortex-compact 75.69 MB 0 B 75.69 MB -100.0%
hits_073.vortex 1.0 vortex-compact 134.21 MB 0 B 134.21 MB -100.0%
hits_074.vortex 1.0 vortex-compact 153.21 MB 0 B 153.21 MB -100.0%
hits_075.vortex 1.0 vortex-compact 139.14 MB 0 B 139.14 MB -100.0%
hits_076.vortex 1.0 vortex-compact 125.51 MB 0 B 125.51 MB -100.0%
hits_077.vortex 1.0 vortex-compact 134.34 MB 0 B 134.34 MB -100.0%
hits_078.vortex 1.0 vortex-compact 97.63 MB 0 B 97.63 MB -100.0%
hits_079.vortex 1.0 vortex-compact 128.17 MB 0 B 128.17 MB -100.0%
hits_080.vortex 1.0 vortex-compact 96.30 MB 0 B 96.30 MB -100.0%
hits_081.vortex 1.0 vortex-compact 153.78 MB 0 B 153.78 MB -100.0%
hits_082.vortex 1.0 vortex-compact 105.71 MB 0 B 105.71 MB -100.0%
hits_083.vortex 1.0 vortex-compact 110.13 MB 0 B 110.13 MB -100.0%
hits_084.vortex 1.0 vortex-compact 110.69 MB 0 B 110.69 MB -100.0%
hits_085.vortex 1.0 vortex-compact 153.20 MB 0 B 153.20 MB -100.0%
hits_086.vortex 1.0 vortex-compact 139.57 MB 0 B 139.57 MB -100.0%
hits_087.vortex 1.0 vortex-compact 125.96 MB 0 B 125.96 MB -100.0%
hits_088.vortex 1.0 vortex-compact 133.99 MB 0 B 133.99 MB -100.0%
hits_089.vortex 1.0 vortex-compact 99.83 MB 0 B 99.83 MB -100.0%
hits_090.vortex 1.0 vortex-compact 140.04 MB 0 B 140.04 MB -100.0%
hits_091.vortex 1.0 vortex-compact 112.27 MB 0 B 112.27 MB -100.0%
hits_092.vortex 1.0 vortex-compact 153.43 MB 0 B 153.43 MB -100.0%
hits_093.vortex 1.0 vortex-compact 98.86 MB 0 B 98.86 MB -100.0%
hits_094.vortex 1.0 vortex-compact 110.59 MB 0 B 110.59 MB -100.0%
hits_095.vortex 1.0 vortex-compact 110.99 MB 0 B 110.99 MB -100.0%
hits_096.vortex 1.0 vortex-compact 153.27 MB 0 B 153.27 MB -100.0%
hits_097.vortex 1.0 vortex-compact 141.42 MB 0 B 141.42 MB -100.0%
hits_098.vortex 1.0 vortex-compact 102.88 MB 0 B 102.88 MB -100.0%
hits_099.vortex 1.0 vortex-compact 133.18 MB 0 B 133.18 MB -100.0%

Totals:

  • vortex-compact: 11.94 GB → 0 B (-100.0%)
  • vortex-file-compressed: 15.97 GB → 15.97 GB (-0.0%)

@github-actions

github-actions Bot commented Jul 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Verdict: Likely improvement (high confidence)
Attributed Vortex impact: -24.1%
Engines: DuckDB Likely improvement (-24.1%, high confidence)
Vortex (geomean): 0.763x ✅
Parquet (geomean): 1.005x ➖
Shifts: Parquet (control) +0.5% · Median polish -16.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (0.763x ✅, 8↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12140836 11910939 1.02
statpopgen_q01/duckdb:vortex-file-compressed 12193713 12559820 0.97
statpopgen_q02/duckdb:vortex-file-compressed 🚀 321370623 513146041 0.63
statpopgen_q03/duckdb:vortex-file-compressed 🚀 734742690 1064678803 0.69
statpopgen_q04/duckdb:vortex-file-compressed 🚀 755247906 1029446233 0.73
statpopgen_q05/duckdb:vortex-file-compressed 🚀 308942051 466932219 0.66
statpopgen_q06/duckdb:vortex-file-compressed 🚀 906714977 1499727347 0.60
statpopgen_q07/duckdb:vortex-file-compressed 184571218 190308723 0.97
statpopgen_q08/duckdb:vortex-file-compressed 🚀 199782445 224642007 0.89
statpopgen_q09/duckdb:vortex-file-compressed 🚀 556421329 815688968 0.68
statpopgen_q10/duckdb:vortex-file-compressed 🚀 1754818433 2532199805 0.69
duckdb / parquet (1.005x ➖, 0↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 329642531 333251240 0.99
statpopgen_q01/duckdb:parquet 417595722 406683935 1.03
statpopgen_q02/duckdb:parquet 786826555 791080574 0.99
statpopgen_q03/duckdb:parquet 1216370688 1206973761 1.01
statpopgen_q04/duckdb:parquet 1234455018 1217327747 1.01
statpopgen_q05/duckdb:parquet 847864780 834204610 1.02
statpopgen_q06/duckdb:parquet 1460902238 1457700680 1.00
statpopgen_q07/duckdb:parquet 910151949 880461180 1.03
statpopgen_q08/duckdb:parquet 878866079 892813999 0.98
statpopgen_q09/duckdb:parquet 1030680739 1036182497 0.99
statpopgen_q10/duckdb:parquet 2239694117 2246940857 1.00
File Size Changes (3 files changed, -42.8% overall, 0↑ 3↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.66 GB 310.78 MB -15.5%
duckdb.db 100000 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 960.66 MB 0 B 960.66 MB -100.0%

Totals:

  • vortex-compact: 960.92 MB → 0 B (-100.0%)
  • vortex-file-compressed: 1.96 GB → 1.66 GB (-15.5%)

@github-actions

github-actions Bot commented Jul 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-0.5%, low confidence) · DuckDB No clear signal (-0.7%, low confidence)
Vortex (geomean): 0.990x ➖
Parquet (geomean): 0.995x ➖
Shifts: Parquet (control) -0.5% · Median polish -1.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.983x ➖, 2↑ 1↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1601657 1633183 0.98
clickbench_q01/datafusion:vortex-file-compressed 17263166 17471501 0.99
clickbench_q02/datafusion:vortex-file-compressed 32938100 33403313 0.99
clickbench_q03/datafusion:vortex-file-compressed 36425173 40123609 0.91
clickbench_q04/datafusion:vortex-file-compressed 231879969 238809553 0.97
clickbench_q05/datafusion:vortex-file-compressed 297584626 313709898 0.95
clickbench_q06/datafusion:vortex-file-compressed 1639448 1679385 0.98
clickbench_q07/datafusion:vortex-file-compressed 21577260 22066349 0.98
clickbench_q08/datafusion:vortex-file-compressed 323450094 331161802 0.98
clickbench_q09/datafusion:vortex-file-compressed 463561918 451645352 1.03
clickbench_q10/datafusion:vortex-file-compressed 70430592 73180583 0.96
clickbench_q11/datafusion:vortex-file-compressed 85920697 86317112 1.00
clickbench_q12/datafusion:vortex-file-compressed 254436930 262515086 0.97
clickbench_q13/datafusion:vortex-file-compressed 422790080 420664127 1.01
clickbench_q14/datafusion:vortex-file-compressed 249132193 255274509 0.98
clickbench_q15/datafusion:vortex-file-compressed 275831724 283114182 0.97
clickbench_q16/datafusion:vortex-file-compressed 646861201 687791641 0.94
clickbench_q17/datafusion:vortex-file-compressed 650372093 676406431 0.96
clickbench_q18/datafusion:vortex-file-compressed 1333537620 1418880535 0.94
clickbench_q19/datafusion:vortex-file-compressed 🚀 24762939 29457343 0.84
clickbench_q20/datafusion:vortex-file-compressed 254065049 261582289 0.97
clickbench_q21/datafusion:vortex-file-compressed 355073480 347412992 1.02
clickbench_q22/datafusion:vortex-file-compressed 440356724 438839871 1.00
clickbench_q23/datafusion:vortex-file-compressed 571701008 608983840 0.94
clickbench_q24/datafusion:vortex-file-compressed 45910145 43009860 1.07
clickbench_q25/datafusion:vortex-file-compressed 71612718 72042005 0.99
clickbench_q26/datafusion:vortex-file-compressed 🚨 46310140 41315370 1.12
clickbench_q27/datafusion:vortex-file-compressed 378885084 373407536 1.01
clickbench_q28/datafusion:vortex-file-compressed 2291459202 2290427672 1.00
clickbench_q29/datafusion:vortex-file-compressed 51574916 53219380 0.97
clickbench_q30/datafusion:vortex-file-compressed 227103545 232238436 0.98
clickbench_q31/datafusion:vortex-file-compressed 241401867 242754347 0.99
clickbench_q32/datafusion:vortex-file-compressed 1022352035 1041671028 0.98
clickbench_q33/datafusion:vortex-file-compressed 1363112756 1355975639 1.01
clickbench_q34/datafusion:vortex-file-compressed 1364829756 1371348242 1.00
clickbench_q35/datafusion:vortex-file-compressed 236723006 237831278 1.00
clickbench_q36/datafusion:vortex-file-compressed 57172561 55717655 1.03
clickbench_q37/datafusion:vortex-file-compressed 25199318 24276143 1.04
clickbench_q38/datafusion:vortex-file-compressed 15159681 15632859 0.97
clickbench_q39/datafusion:vortex-file-compressed 118578690 122664577 0.97
clickbench_q40/datafusion:vortex-file-compressed 🚀 11464282 13046898 0.88
clickbench_q41/datafusion:vortex-file-compressed 11498869 11325984 1.02
clickbench_q42/datafusion:vortex-file-compressed 11907340 11334469 1.05
datafusion / parquet (0.987x ➖, 0↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1554225 1595109 0.97
clickbench_q01/datafusion:parquet 18838011 20204762 0.93
clickbench_q02/datafusion:parquet 43271130 43375047 1.00
clickbench_q03/datafusion:parquet 35652911 36282165 0.98
clickbench_q04/datafusion:parquet 265175298 263715238 1.01
clickbench_q05/datafusion:parquet 306707211 308927874 0.99
clickbench_q06/datafusion:parquet 1521733 1485576 1.02
clickbench_q07/datafusion:parquet 21310663 20660809 1.03
clickbench_q08/datafusion:parquet 333564692 336997313 0.99
clickbench_q09/datafusion:parquet 463522255 468093653 0.99
clickbench_q10/datafusion:parquet 91209944 91696934 0.99
clickbench_q11/datafusion:parquet 115971497 117220862 0.99
clickbench_q12/datafusion:parquet 297242094 293263131 1.01
clickbench_q13/datafusion:parquet 463199112 466830658 0.99
clickbench_q14/datafusion:parquet 313119588 311899254 1.00
clickbench_q15/datafusion:parquet 273135753 278720952 0.98
clickbench_q16/datafusion:parquet 638460161 657142072 0.97
clickbench_q17/datafusion:parquet 637133099 647355929 0.98
clickbench_q18/datafusion:parquet 1371267789 1375648290 1.00
clickbench_q19/datafusion:parquet 27309184 26363550 1.04
clickbench_q20/datafusion:parquet 561368476 573076720 0.98
clickbench_q21/datafusion:parquet 616810723 632924024 0.97
clickbench_q22/datafusion:parquet 904082096 909094078 0.99
clickbench_q23/datafusion:parquet 4032164569 4085509261 0.99
clickbench_q24/datafusion:parquet 51480505 52596636 0.98
clickbench_q25/datafusion:parquet 127934834 131118014 0.98
clickbench_q26/datafusion:parquet 52144548 55958885 0.93
clickbench_q27/datafusion:parquet 651283516 657037945 0.99
clickbench_q28/datafusion:parquet 2483183619 2453049536 1.01
clickbench_q29/datafusion:parquet 44418834 44013903 1.01
clickbench_q30/datafusion:parquet 317577586 314871431 1.01
clickbench_q31/datafusion:parquet 349402575 333027371 1.05
clickbench_q32/datafusion:parquet 1077627191 1120400410 0.96
clickbench_q33/datafusion:parquet 1482829646 1502386346 0.99
clickbench_q34/datafusion:parquet 1493620716 1509904164 0.99
clickbench_q35/datafusion:parquet 245000310 255453577 0.96
clickbench_q36/datafusion:parquet 106886065 107437850 0.99
clickbench_q37/datafusion:parquet 41813522 42995693 0.97
clickbench_q38/datafusion:parquet 61849270 61891492 1.00
clickbench_q39/datafusion:parquet 206007945 215570116 0.96
clickbench_q40/datafusion:parquet 22195101 24156407 0.92
clickbench_q41/datafusion:parquet 22196525 22036003 1.01
clickbench_q42/datafusion:parquet 22256294 23526878 0.95
duckdb / vortex-file-compressed (0.996x ➖, 1↑ 2↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 10026893 10656450 0.94
clickbench_q01/duckdb:vortex-file-compressed 15368846 15557808 0.99
clickbench_q02/duckdb:vortex-file-compressed 21043494 21205048 0.99
clickbench_q03/duckdb:vortex-file-compressed 25960745 27115464 0.96
clickbench_q04/duckdb:vortex-file-compressed 199887612 204000476 0.98
clickbench_q05/duckdb:vortex-file-compressed 184506801 195364709 0.94
clickbench_q06/duckdb:vortex-file-compressed 18783619 18878327 0.99
clickbench_q07/duckdb:vortex-file-compressed 19962318 19816988 1.01
clickbench_q08/duckdb:vortex-file-compressed 267484899 272812817 0.98
clickbench_q09/duckdb:vortex-file-compressed 352646633 351413120 1.00
clickbench_q10/duckdb:vortex-file-compressed 75300252 72539710 1.04
clickbench_q11/duckdb:vortex-file-compressed 83808332 85280650 0.98
clickbench_q12/duckdb:vortex-file-compressed 211103214 209790940 1.01
clickbench_q13/duckdb:vortex-file-compressed 424274547 413740908 1.03
clickbench_q14/duckdb:vortex-file-compressed 244637125 242453664 1.01
clickbench_q15/duckdb:vortex-file-compressed 254512644 250653784 1.02
clickbench_q16/duckdb:vortex-file-compressed 548957017 538248896 1.02
clickbench_q17/duckdb:vortex-file-compressed 448349711 434366851 1.03
clickbench_q18/duckdb:vortex-file-compressed 944312907 954568012 0.99
clickbench_q19/duckdb:vortex-file-compressed 20519225 21674796 0.95
clickbench_q20/duckdb:vortex-file-compressed 247579024 254098369 0.97
clickbench_q21/duckdb:vortex-file-compressed 320885913 329560913 0.97
clickbench_q22/duckdb:vortex-file-compressed 503085631 479379126 1.05
clickbench_q23/duckdb:vortex-file-compressed 141534094 148938569 0.95
clickbench_q24/duckdb:vortex-file-compressed 🚨 47784731 36565484 1.31
clickbench_q25/duckdb:vortex-file-compressed 80920705 73764866 1.10
clickbench_q26/duckdb:vortex-file-compressed 🚨 49488748 42519923 1.16
clickbench_q27/duckdb:vortex-file-compressed 217057623 220783295 0.98
clickbench_q28/duckdb:vortex-file-compressed 3028735830 3035260806 1.00
clickbench_q29/duckdb:vortex-file-compressed 27360513 26842700 1.02
clickbench_q30/duckdb:vortex-file-compressed 195411464 204170750 0.96
clickbench_q31/duckdb:vortex-file-compressed 287055557 306072703 0.94
clickbench_q32/duckdb:vortex-file-compressed 1116393394 1142305887 0.98
clickbench_q33/duckdb:vortex-file-compressed 1105389083 1181477285 0.94
clickbench_q34/duckdb:vortex-file-compressed 1190251406 1216267550 0.98
clickbench_q35/duckdb:vortex-file-compressed 372545208 371947121 1.00
clickbench_q36/duckdb:vortex-file-compressed 32297767 31707284 1.02
clickbench_q37/duckdb:vortex-file-compressed 21397219 22266609 0.96
clickbench_q38/duckdb:vortex-file-compressed 25839108 25233223 1.02
clickbench_q39/duckdb:vortex-file-compressed 47243419 46830552 1.01
clickbench_q40/duckdb:vortex-file-compressed 🚀 20928601 24368402 0.86
clickbench_q41/duckdb:vortex-file-compressed 20408259 22389650 0.91
clickbench_q42/duckdb:vortex-file-compressed 21503963 21614869 0.99
duckdb / parquet (1.003x ➖, 0↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 23844829 23780667 1.00
clickbench_q01/duckdb:parquet 31337050 29978616 1.05
clickbench_q02/duckdb:parquet 51829340 50593695 1.02
clickbench_q03/duckdb:parquet 41289057 40897111 1.01
clickbench_q04/duckdb:parquet 203999980 205026855 0.99
clickbench_q05/duckdb:parquet 261348284 263244928 0.99
clickbench_q06/duckdb:parquet 47579260 48356583 0.98
clickbench_q07/duckdb:parquet 32236506 32705472 0.99
clickbench_q08/duckdb:parquet 277860197 278029180 1.00
clickbench_q09/duckdb:parquet 405312208 405171358 1.00
clickbench_q10/duckdb:parquet 83975685 86092338 0.98
clickbench_q11/duckdb:parquet 103086427 102841434 1.00
clickbench_q12/duckdb:parquet 283309173 284362130 1.00
clickbench_q13/duckdb:parquet 473650506 479242304 0.99
clickbench_q14/duckdb:parquet 317839557 316059462 1.01
clickbench_q15/duckdb:parquet 258015812 254931182 1.01
clickbench_q16/duckdb:parquet 601926635 600780621 1.00
clickbench_q17/duckdb:parquet 500872118 497931381 1.01
clickbench_q18/duckdb:parquet 1027219739 1032156301 1.00
clickbench_q19/duckdb:parquet 29936624 29070853 1.03
clickbench_q20/duckdb:parquet 424839761 415876735 1.02
clickbench_q21/duckdb:parquet 534473417 531085596 1.01
clickbench_q22/duckdb:parquet 920805813 925805046 0.99
clickbench_q23/duckdb:parquet 276030826 271402351 1.02
clickbench_q24/duckdb:parquet 72580038 71764936 1.01
clickbench_q25/duckdb:parquet 165427836 163679923 1.01
clickbench_q26/duckdb:parquet 55747651 56367047 0.99
clickbench_q27/duckdb:parquet 479889837 473643735 1.01
clickbench_q28/duckdb:parquet 4770872724 4779277779 1.00
clickbench_q29/duckdb:parquet 43065762 43451639 0.99
clickbench_q30/duckdb:parquet 316974401 315842860 1.00
clickbench_q31/duckdb:parquet 379771072 380712257 1.00
clickbench_q32/duckdb:parquet 1111131995 1119673210 0.99
clickbench_q33/duckdb:parquet 1103402082 1119198562 0.99
clickbench_q34/duckdb:parquet 1155642095 1161748672 0.99
clickbench_q35/duckdb:parquet 367960342 375418085 0.98
clickbench_q36/duckdb:parquet 47662243 46550391 1.02
clickbench_q37/duckdb:parquet 36328851 34740425 1.05
clickbench_q38/duckdb:parquet 36913826 36707368 1.01
clickbench_q39/duckdb:parquet 91345980 92872496 0.98
clickbench_q40/duckdb:parquet 21750439 20807968 1.05
clickbench_q41/duckdb:parquet 20833406 21015613 0.99
clickbench_q42/duckdb:parquet 23937363 24400881 0.98
File Size Changes (101 files changed, -39.2% overall, 0↑ 101↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_0.vortex 1.0 vortex-compact 58.88 MB 0 B 58.88 MB -100.0%
hits_1.vortex 1.0 vortex-compact 90.67 MB 0 B 90.67 MB -100.0%
hits_10.vortex 1.0 vortex-compact 49.48 MB 0 B 49.48 MB -100.0%
hits_11.vortex 1.0 vortex-compact 56.11 MB 0 B 56.11 MB -100.0%
hits_12.vortex 1.0 vortex-compact 69.86 MB 0 B 69.86 MB -100.0%
hits_13.vortex 1.0 vortex-compact 69.24 MB 0 B 69.24 MB -100.0%
hits_14.vortex 1.0 vortex-compact 74.88 MB 0 B 74.88 MB -100.0%
hits_15.vortex 1.0 vortex-compact 48.41 MB 0 B 48.41 MB -100.0%
hits_16.vortex 1.0 vortex-compact 49.56 MB 0 B 49.56 MB -100.0%
hits_17.vortex 1.0 vortex-compact 58.79 MB 0 B 58.79 MB -100.0%
hits_18.vortex 1.0 vortex-compact 64.89 MB 0 B 64.89 MB -100.0%
hits_19.vortex 1.0 vortex-compact 49.73 MB 0 B 49.73 MB -100.0%
hits_2.vortex 1.0 vortex-compact 129.16 MB 0 B 129.16 MB -100.0%
hits_20.vortex 1.0 vortex-compact 38.36 MB 0 B 38.36 MB -100.0%
hits_21.vortex 1.0 vortex-compact 51.99 MB 0 B 51.99 MB -100.0%
hits_22.vortex 1.0 vortex-compact 46.22 MB 0 B 46.22 MB -100.0%
hits_23.vortex 1.0 vortex-compact 46.13 MB 0 B 46.13 MB -100.0%
hits_24.vortex 1.0 vortex-compact 45.11 MB 0 B 45.11 MB -100.0%
hits_25.vortex 1.0 vortex-compact 73.88 MB 0 B 73.88 MB -100.0%
hits_26.vortex 1.0 vortex-compact 71.99 MB 0 B 71.99 MB -100.0%
hits_27.vortex 1.0 vortex-compact 69.86 MB 0 B 69.86 MB -100.0%
hits_28.vortex 1.0 vortex-compact 70.92 MB 0 B 70.92 MB -100.0%
hits_29.vortex 1.0 vortex-compact 36.68 MB 0 B 36.68 MB -100.0%
hits_3.vortex 1.0 vortex-compact 95.12 MB 0 B 95.12 MB -100.0%
hits_30.vortex 1.0 vortex-compact 58.57 MB 0 B 58.57 MB -100.0%
hits_31.vortex 1.0 vortex-compact 55.77 MB 0 B 55.77 MB -100.0%
hits_32.vortex 1.0 vortex-compact 44.61 MB 0 B 44.61 MB -100.0%
hits_33.vortex 1.0 vortex-compact 35.92 MB 0 B 35.92 MB -100.0%
hits_34.vortex 1.0 vortex-compact 58.24 MB 0 B 58.24 MB -100.0%
hits_35.vortex 1.0 vortex-compact 75.53 MB 0 B 75.53 MB -100.0%
hits_36.vortex 1.0 vortex-compact 49.21 MB 0 B 49.21 MB -100.0%
hits_37.vortex 1.0 vortex-compact 54.76 MB 0 B 54.76 MB -100.0%
hits_38.vortex 1.0 vortex-compact 63.39 MB 0 B 63.39 MB -100.0%
hits_39.vortex 1.0 vortex-compact 50.10 MB 0 B 50.10 MB -100.0%
hits_4.vortex 1.0 vortex-compact 71.94 MB 0 B 71.94 MB -100.0%
hits_40.vortex 1.0 vortex-compact 77.42 MB 0 B 77.42 MB -100.0%
hits_41.vortex 1.0 vortex-compact 166.05 MB 0 B 166.05 MB -100.0%
hits_42.vortex 1.0 vortex-compact 164.53 MB 0 B 164.53 MB -100.0%
hits_43.vortex 1.0 vortex-compact 169.21 MB 0 B 169.21 MB -100.0%
hits_44.vortex 1.0 vortex-compact 133.26 MB 0 B 133.26 MB -100.0%
hits_45.vortex 1.0 vortex-compact 75.80 MB 0 B 75.80 MB -100.0%
hits_46.vortex 1.0 vortex-compact 42.27 MB 0 B 42.27 MB -100.0%
hits_47.vortex 1.0 vortex-compact 18.22 MB 0 B 18.22 MB -100.0%
hits_48.vortex 1.0 vortex-compact 17.85 MB 0 B 17.85 MB -100.0%
hits_49.vortex 1.0 vortex-compact 51.00 MB 0 B 51.00 MB -100.0%
hits_5.vortex 1.0 vortex-compact 63.33 MB 0 B 63.33 MB -100.0%
hits_50.vortex 1.0 vortex-compact 114.20 MB 0 B 114.20 MB -100.0%
hits_51.vortex 1.0 vortex-compact 168.34 MB 0 B 168.34 MB -100.0%
hits_52.vortex 1.0 vortex-compact 65.08 MB 0 B 65.08 MB -100.0%
hits_53.vortex 1.0 vortex-compact 60.05 MB 0 B 60.05 MB -100.0%
hits_54.vortex 1.0 vortex-compact 117.57 MB 0 B 117.57 MB -100.0%
hits_55.vortex 1.0 vortex-compact 92.56 MB 0 B 92.56 MB -100.0%
hits_56.vortex 1.0 vortex-compact 78.58 MB 0 B 78.58 MB -100.0%
hits_57.vortex 1.0 vortex-compact 83.73 MB 0 B 83.73 MB -100.0%
hits_58.vortex 1.0 vortex-compact 61.24 MB 0 B 61.24 MB -100.0%
hits_59.vortex 1.0 vortex-compact 66.68 MB 0 B 66.68 MB -100.0%
hits_6.vortex 1.0 vortex-compact 63.57 MB 0 B 63.57 MB -100.0%
hits_60.vortex 1.0 vortex-compact 64.92 MB 0 B 64.92 MB -100.0%
hits_61.vortex 1.0 vortex-compact 57.73 MB 0 B 57.73 MB -100.0%
hits_62.vortex 1.0 vortex-compact 75.45 MB 0 B 75.45 MB -100.0%
hits_63.vortex 1.0 vortex-compact 46.44 MB 0 B 46.44 MB -100.0%
hits_64.vortex 1.0 vortex-compact 54.09 MB 0 B 54.09 MB -100.0%
hits_65.vortex 1.0 vortex-compact 129.40 MB 0 B 129.40 MB -100.0%
hits_66.vortex 1.0 vortex-compact 53.52 MB 0 B 53.52 MB -100.0%
hits_67.vortex 1.0 vortex-compact 114.44 MB 0 B 114.44 MB -100.0%
hits_68.vortex 1.0 vortex-compact 76.67 MB 0 B 76.67 MB -100.0%
hits_69.vortex 1.0 vortex-compact 80.98 MB 0 B 80.98 MB -100.0%
hits_7.vortex 1.0 vortex-compact 64.19 MB 0 B 64.19 MB -100.0%
hits_70.vortex 1.0 vortex-compact 61.84 MB 0 B 61.84 MB -100.0%
hits_71.vortex 1.0 vortex-compact 69.96 MB 0 B 69.96 MB -100.0%
hits_72.vortex 1.0 vortex-compact 52.74 MB 0 B 52.74 MB -100.0%
hits_73.vortex 1.0 vortex-compact 71.07 MB 0 B 71.07 MB -100.0%
hits_74.vortex 1.0 vortex-compact 71.87 MB 0 B 71.87 MB -100.0%
hits_75.vortex 1.0 vortex-compact 45.12 MB 0 B 45.12 MB -100.0%
hits_76.vortex 1.0 vortex-compact 77.10 MB 0 B 77.10 MB -100.0%
hits_77.vortex 1.0 vortex-compact 118.50 MB 0 B 118.50 MB -100.0%
hits_78.vortex 1.0 vortex-compact 97.85 MB 0 B 97.85 MB -100.0%
hits_79.vortex 1.0 vortex-compact 86.17 MB 0 B 86.17 MB -100.0%
hits_8.vortex 1.0 vortex-compact 63.39 MB 0 B 63.39 MB -100.0%
hits_80.vortex 1.0 vortex-compact 68.67 MB 0 B 68.67 MB -100.0%
hits_81.vortex 1.0 vortex-compact 65.95 MB 0 B 65.95 MB -100.0%
hits_82.vortex 1.0 vortex-compact 67.43 MB 0 B 67.43 MB -100.0%
hits_83.vortex 1.0 vortex-compact 53.62 MB 0 B 53.62 MB -100.0%
hits_84.vortex 1.0 vortex-compact 74.35 MB 0 B 74.35 MB -100.0%
hits_85.vortex 1.0 vortex-compact 52.86 MB 0 B 52.86 MB -100.0%
hits_86.vortex 1.0 vortex-compact 49.12 MB 0 B 49.12 MB -100.0%
hits_87.vortex 1.0 vortex-compact 118.86 MB 0 B 118.86 MB -100.0%
hits_88.vortex 1.0 vortex-compact 73.58 MB 0 B 73.58 MB -100.0%
hits_89.vortex 1.0 vortex-compact 114.10 MB 0 B 114.10 MB -100.0%
hits_9.vortex 1.0 vortex-compact 66.32 MB 0 B 66.32 MB -100.0%
hits_90.vortex 1.0 vortex-compact 82.09 MB 0 B 82.09 MB -100.0%
hits_91.vortex 1.0 vortex-compact 61.24 MB 0 B 61.24 MB -100.0%
hits_92.vortex 1.0 vortex-compact 94.40 MB 0 B 94.40 MB -100.0%
hits_93.vortex 1.0 vortex-compact 59.92 MB 0 B 59.92 MB -100.0%
hits_94.vortex 1.0 vortex-compact 90.90 MB 0 B 90.90 MB -100.0%
hits_95.vortex 1.0 vortex-compact 58.20 MB 0 B 58.20 MB -100.0%
hits_96.vortex 1.0 vortex-compact 91.73 MB 0 B 91.73 MB -100.0%
hits_97.vortex 1.0 vortex-compact 69.58 MB 0 B 69.58 MB -100.0%
hits_98.vortex 1.0 vortex-compact 73.15 MB 0 B 73.15 MB -100.0%
hits_99.vortex 1.0 vortex-compact 77.65 MB 0 B 77.65 MB -100.0%

Totals:

  • vortex-compact: 7.11 GB → 0 B (-100.0%)
  • vortex-file-compressed: 11.04 GB → 11.04 GB (0.0%)

@github-actions

github-actions Bot commented Jul 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.1%
Engines: DataFusion No clear signal (+1.4%, low confidence) · DuckDB No clear signal (+2.8%, low confidence)
Vortex (geomean): 1.057x ➖
Parquet (geomean): 1.036x ➖
Shifts: Parquet (control) +3.6% · Median polish +5.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.064x ➖, 0↑ 5↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 449370449 425050967 1.06
tpch_q02/datafusion:vortex-file-compressed 106600708 101811609 1.05
tpch_q03/datafusion:vortex-file-compressed 197715654 192052693 1.03
tpch_q04/datafusion:vortex-file-compressed 94998061 95770764 0.99
tpch_q05/datafusion:vortex-file-compressed 336002188 327210910 1.03
tpch_q06/datafusion:vortex-file-compressed 38931430 39789732 0.98
tpch_q07/datafusion:vortex-file-compressed 471293970 448326795 1.05
tpch_q08/datafusion:vortex-file-compressed 355440654 332450591 1.07
tpch_q09/datafusion:vortex-file-compressed 🚨 644704618 581037554 1.11
tpch_q10/datafusion:vortex-file-compressed 230300936 214896549 1.07
tpch_q11/datafusion:vortex-file-compressed 82441019 76185863 1.08
tpch_q12/datafusion:vortex-file-compressed 120264102 110288091 1.09
tpch_q13/datafusion:vortex-file-compressed 🚨 212589148 190846380 1.11
tpch_q14/datafusion:vortex-file-compressed 52941614 49200123 1.08
tpch_q15/datafusion:vortex-file-compressed 105335596 101014610 1.04
tpch_q16/datafusion:vortex-file-compressed 78364683 76593977 1.02
tpch_q17/datafusion:vortex-file-compressed 🚨 632197356 569152076 1.11
tpch_q18/datafusion:vortex-file-compressed 🚨 887083292 804339511 1.10
tpch_q19/datafusion:vortex-file-compressed 78437419 73309913 1.07
tpch_q20/datafusion:vortex-file-compressed 165156092 151456064 1.09
tpch_q21/datafusion:vortex-file-compressed 🚨 658863804 583303248 1.13
tpch_q22/datafusion:vortex-file-compressed 53461821 50277348 1.06
datafusion / parquet (1.050x ➖, 0↑ 1↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 480383672 462539897 1.04
tpch_q02/datafusion:parquet 168466635 158861181 1.06
tpch_q03/datafusion:parquet 260495274 251108184 1.04
tpch_q04/datafusion:parquet 119307394 113385124 1.05
tpch_q05/datafusion:parquet 403472937 385338436 1.05
tpch_q06/datafusion:parquet 135898510 126077164 1.08
tpch_q07/datafusion:parquet 581679220 548401770 1.06
tpch_q08/datafusion:parquet 467271340 441105674 1.06
tpch_q09/datafusion:parquet 746930496 713868825 1.05
tpch_q10/datafusion:parquet 551025618 519714712 1.06
tpch_q11/datafusion:parquet 127447045 120480728 1.06
tpch_q12/datafusion:parquet 217962809 210422533 1.04
tpch_q13/datafusion:parquet 352473651 343516201 1.03
tpch_q14/datafusion:parquet 156033721 150912705 1.03
tpch_q15/datafusion:parquet 281316956 262941029 1.07
tpch_q16/datafusion:parquet 🚨 127018445 115433955 1.10
tpch_q17/datafusion:parquet 695157241 669953283 1.04
tpch_q18/datafusion:parquet 895505806 851168443 1.05
tpch_q19/datafusion:parquet 289223653 272326772 1.06
tpch_q20/datafusion:parquet 304288312 301295645 1.01
tpch_q21/datafusion:parquet 669024072 647827541 1.03
tpch_q22/datafusion:parquet 219102046 210595723 1.04
duckdb / vortex-file-compressed (1.051x ➖, 0↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 173372790 169593370 1.02
tpch_q02/duckdb:vortex-file-compressed 56046949 53129691 1.05
tpch_q03/duckdb:vortex-file-compressed 128398200 119237721 1.08
tpch_q04/duckdb:vortex-file-compressed 161769689 152129900 1.06
tpch_q05/duckdb:vortex-file-compressed 142542615 135621825 1.05
tpch_q06/duckdb:vortex-file-compressed 36513730 34276344 1.07
tpch_q07/duckdb:vortex-file-compressed 137614113 127372583 1.08
tpch_q08/duckdb:vortex-file-compressed 182972882 169281521 1.08
tpch_q09/duckdb:vortex-file-compressed 404195018 388612851 1.04
tpch_q10/duckdb:vortex-file-compressed 199542774 190825986 1.05
tpch_q11/duckdb:vortex-file-compressed 31676863 30696208 1.03
tpch_q12/duckdb:vortex-file-compressed 110765632 105199280 1.05
tpch_q13/duckdb:vortex-file-compressed 282828410 268804735 1.05
tpch_q14/duckdb:vortex-file-compressed 54944937 53476465 1.03
tpch_q15/duckdb:vortex-file-compressed 92570020 87490934 1.06
tpch_q16/duckdb:vortex-file-compressed 81452262 75835380 1.07
tpch_q17/duckdb:vortex-file-compressed 92196582 88516918 1.04
tpch_q18/duckdb:vortex-file-compressed 298363469 290822446 1.03
tpch_q19/duckdb:vortex-file-compressed 76310701 75962169 1.00
tpch_q20/duckdb:vortex-file-compressed 144251834 139266606 1.04
tpch_q21/duckdb:vortex-file-compressed 508004572 472292322 1.08
tpch_q22/duckdb:vortex-file-compressed 66830188 63188514 1.06
duckdb / parquet (1.022x ➖, 0↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 269891868 266002109 1.01
tpch_q02/duckdb:parquet 108268325 106548735 1.02
tpch_q03/duckdb:parquet 222678176 213831785 1.04
tpch_q04/duckdb:parquet 140571722 138224147 1.02
tpch_q05/duckdb:parquet 232712688 224658821 1.04
tpch_q06/duckdb:parquet 75586940 75518086 1.00
tpch_q07/duckdb:parquet 193753720 190910314 1.01
tpch_q08/duckdb:parquet 278133349 269019539 1.03
tpch_q09/duckdb:parquet 522161250 513300706 1.02
tpch_q10/duckdb:parquet 647218497 627747197 1.03
tpch_q11/duckdb:parquet 67142161 62634291 1.07
tpch_q12/duckdb:parquet 137871799 134393064 1.03
tpch_q13/duckdb:parquet 466380328 456476980 1.02
tpch_q14/duckdb:parquet 181913280 182457680 1.00
tpch_q15/duckdb:parquet 107538608 104982699 1.02
tpch_q16/duckdb:parquet 167934403 167188018 1.00
tpch_q17/duckdb:parquet 183779723 183103768 1.00
tpch_q18/duckdb:parquet 373415214 360329060 1.04
tpch_q19/duckdb:parquet 290752089 291137824 1.00
tpch_q20/duckdb:parquet 237534008 235026115 1.01
tpch_q21/duckdb:parquet 598222482 575864723 1.04
tpch_q22/duckdb:parquet 311126860 303892237 1.02
File Size Changes (25 files changed, -44.0% overall, 0↑ 25↓)
File Scale Format Base HEAD Change %
customer_0.vortex 10.0 vortex-compact 74.00 MB 0 B 74.00 MB -100.0%
duckdb.db 10.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem_0.vortex 10.0 vortex-compact 100.59 MB 0 B 100.59 MB -100.0%
lineitem_1.vortex 10.0 vortex-compact 100.64 MB 0 B 100.64 MB -100.0%
lineitem_10.vortex 10.0 vortex-compact 100.83 MB 0 B 100.83 MB -100.0%
lineitem_11.vortex 10.0 vortex-compact 100.75 MB 0 B 100.75 MB -100.0%
lineitem_12.vortex 10.0 vortex-compact 100.62 MB 0 B 100.62 MB -100.0%
lineitem_2.vortex 10.0 vortex-compact 100.79 MB 0 B 100.79 MB -100.0%
lineitem_3.vortex 10.0 vortex-compact 100.85 MB 0 B 100.85 MB -100.0%
lineitem_4.vortex 10.0 vortex-compact 100.55 MB 0 B 100.55 MB -100.0%
lineitem_5.vortex 10.0 vortex-compact 100.70 MB 0 B 100.70 MB -100.0%
lineitem_6.vortex 10.0 vortex-compact 100.88 MB 0 B 100.88 MB -100.0%
lineitem_7.vortex 10.0 vortex-compact 100.79 MB 0 B 100.79 MB -100.0%
lineitem_8.vortex 10.0 vortex-compact 100.59 MB 0 B 100.59 MB -100.0%
lineitem_9.vortex 10.0 vortex-compact 100.46 MB 0 B 100.46 MB -100.0%
nation_0.vortex 10.0 vortex-compact 7.80 KB 0 B 7.80 KB -100.0%
orders_0.vortex 10.0 vortex-compact 114.79 MB 0 B 114.79 MB -100.0%
orders_1.vortex 10.0 vortex-compact 114.76 MB 0 B 114.76 MB -100.0%
orders_2.vortex 10.0 vortex-compact 114.78 MB 0 B 114.78 MB -100.0%
part_0.vortex 10.0 vortex-compact 17.92 MB 0 B 17.92 MB -100.0%
part_1.vortex 10.0 vortex-compact 17.98 MB 0 B 17.98 MB -100.0%
partsupp_0.vortex 10.0 vortex-compact 101.84 MB 0 B 101.84 MB -100.0%
partsupp_1.vortex 10.0 vortex-compact 102.09 MB 0 B 102.09 MB -100.0%
region_0.vortex 10.0 vortex-compact 5.83 KB 0 B 5.83 KB -100.0%
supplier_0.vortex 10.0 vortex-compact 4.73 MB 0 B 4.73 MB -100.0%

Totals:

  • vortex-compact: 1.93 GB → 0 B (-100.0%)
  • vortex-file-compressed: 2.45 GB → 2.45 GB (0.0%)

@github-actions

github-actions Bot commented Jul 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +7.4%
Engines: DataFusion No clear signal (+12.8%, environment too noisy confidence) · DuckDB No clear signal (+2.3%, environment too noisy confidence)
Vortex (geomean): 1.101x ➖
Parquet (geomean): 1.025x ➖
Shifts: Parquet (control) +2.5% · Median polish +4.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.146x ➖, 0↑ 2↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 301244042 271351281 1.11
tpch_q02/datafusion:vortex-file-compressed 522050648 415248096 1.26
tpch_q03/datafusion:vortex-file-compressed 434382477 394625143 1.10
tpch_q04/datafusion:vortex-file-compressed 220440758 198140865 1.11
tpch_q05/datafusion:vortex-file-compressed 396156032 335799950 1.18
tpch_q06/datafusion:vortex-file-compressed 343629058 293008123 1.17
tpch_q07/datafusion:vortex-file-compressed 🚨 552429540 381061367 1.45
tpch_q08/datafusion:vortex-file-compressed 647743346 500798335 1.29
tpch_q09/datafusion:vortex-file-compressed 460852618 411931951 1.12
tpch_q10/datafusion:vortex-file-compressed 470114233 470422119 1.00
tpch_q11/datafusion:vortex-file-compressed 328599142 319349640 1.03
tpch_q12/datafusion:vortex-file-compressed 459040888 380996407 1.20
tpch_q13/datafusion:vortex-file-compressed 207517264 194577096 1.07
tpch_q14/datafusion:vortex-file-compressed 285798258 229189485 1.25
tpch_q15/datafusion:vortex-file-compressed 516478719 429279797 1.20
tpch_q16/datafusion:vortex-file-compressed 🚨 267581303 200994083 1.33
tpch_q17/datafusion:vortex-file-compressed 332590240 308804323 1.08
tpch_q18/datafusion:vortex-file-compressed 272978434 237790162 1.15
tpch_q19/datafusion:vortex-file-compressed 467968428 439484295 1.06
tpch_q20/datafusion:vortex-file-compressed 403714900 380150580 1.06
tpch_q21/datafusion:vortex-file-compressed 541971533 485089580 1.12
tpch_q22/datafusion:vortex-file-compressed 142607820 144119227 0.99
datafusion / parquet (1.017x ➖, 0↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 237091027 232130156 1.02
tpch_q02/datafusion:parquet 387497501 391589507 0.99
tpch_q03/datafusion:parquet 320144054 294311778 1.09
tpch_q04/datafusion:parquet 173040510 135664087 1.28
tpch_q05/datafusion:parquet 470458764 426869188 1.10
tpch_q06/datafusion:parquet 146036617 139703989 1.05
tpch_q07/datafusion:parquet 461406041 453761426 1.02
tpch_q08/datafusion:parquet 569302384 627284621 0.91
tpch_q09/datafusion:parquet 482627791 456254255 1.06
tpch_q10/datafusion:parquet 455424839 532207155 0.86
tpch_q11/datafusion:parquet 366841648 400384789 0.92
tpch_q12/datafusion:parquet 254774178 236523655 1.08
tpch_q13/datafusion:parquet 420871696 443644987 0.95
tpch_q14/datafusion:parquet 181002597 189611503 0.95
tpch_q15/datafusion:parquet 292460560 293512345 1.00
tpch_q16/datafusion:parquet 162397088 181998846 0.89
tpch_q17/datafusion:parquet 398862401 375032008 1.06
tpch_q18/datafusion:parquet 465186981 425507402 1.09
tpch_q19/datafusion:parquet 334211121 297601045 1.12
tpch_q20/datafusion:parquet 311655162 329732416 0.95
tpch_q21/datafusion:parquet 515680592 518107688 1.00
tpch_q22/datafusion:parquet 183451837 167869719 1.09
duckdb / vortex-file-compressed (1.057x ➖, 0↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 263499823 253486742 1.04
tpch_q02/duckdb:vortex-file-compressed 977027274 889222900 1.10
tpch_q03/duckdb:vortex-file-compressed 614167145 600016202 1.02
tpch_q04/duckdb:vortex-file-compressed 383677628 347596106 1.10
tpch_q05/duckdb:vortex-file-compressed 807888801 739741575 1.09
tpch_q06/duckdb:vortex-file-compressed 335739292 318312195 1.05
tpch_q07/duckdb:vortex-file-compressed 867854475 957684469 0.91
tpch_q08/duckdb:vortex-file-compressed 1253206788 1044496108 1.20
tpch_q09/duckdb:vortex-file-compressed 901997516 837961708 1.08
tpch_q10/duckdb:vortex-file-compressed 703169481 671868506 1.05
tpch_q11/duckdb:vortex-file-compressed 460688674 452511848 1.02
tpch_q12/duckdb:vortex-file-compressed 583125488 577439079 1.01
tpch_q13/duckdb:vortex-file-compressed 386241662 388435423 0.99
tpch_q14/duckdb:vortex-file-compressed 421091853 364371601 1.16
tpch_q15/duckdb:vortex-file-compressed 286523111 295876659 0.97
tpch_q16/duckdb:vortex-file-compressed 336279296 337660471 1.00
tpch_q17/duckdb:vortex-file-compressed 705532336 642210116 1.10
tpch_q18/duckdb:vortex-file-compressed 564890835 523609842 1.08
tpch_q19/duckdb:vortex-file-compressed 441662170 439868334 1.00
tpch_q20/duckdb:vortex-file-compressed 771330331 712776512 1.08
tpch_q21/duckdb:vortex-file-compressed 1067931756 984500928 1.08
tpch_q22/duckdb:vortex-file-compressed 275026356 236056245 1.17
duckdb / parquet (1.033x ➖, 0↑ 0↓)
name PR 9182af3 (ns) base 8c1dfc7 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 425819755 402341480 1.06
tpch_q02/duckdb:parquet 1054895043 1047202954 1.01
tpch_q03/duckdb:parquet 983097770 939203171 1.05
tpch_q04/duckdb:parquet 676271941 569133953 1.19
tpch_q05/duckdb:parquet 1190669346 1154201212 1.03
tpch_q06/duckdb:parquet 389628390 384019344 1.01
tpch_q07/duckdb:parquet 1091224788 1120681590 0.97
tpch_q08/duckdb:parquet 1396402341 1325550267 1.05
tpch_q09/duckdb:parquet 1373616550 1229534746 1.12
tpch_q10/duckdb:parquet 1245152706 1144884354 1.09
tpch_q11/duckdb:parquet 677699745 698908664 0.97
tpch_q12/duckdb:parquet 638553013 651323012 0.98
tpch_q13/duckdb:parquet 890941438 857874133 1.04
tpch_q14/duckdb:parquet 623576604 633605539 0.98
tpch_q15/duckdb:parquet 484421323 476917392 1.02
tpch_q16/duckdb:parquet 618612822 642891417 0.96
tpch_q17/duckdb:parquet 738713584 745720187 0.99
tpch_q18/duckdb:parquet 837937078 822602481 1.02
tpch_q19/duckdb:parquet 709101305 714691610 0.99
tpch_q20/duckdb:parquet 1099687658 1025068284 1.07
tpch_q21/duckdb:parquet 970927623 982404014 0.99
tpch_q22/duckdb:parquet 610229371 521782872 1.17

@mhk197 mhk197 mentioned this pull request Jul 23, 2026
Merged
@mhk197
mhk197 force-pushed the mk/enable-list-layout-bench branch from 6ce102b to 8947569 Compare July 27, 2026 15:38
@mhk197 mhk197 added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 27, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 27, 2026
@mhk197
enable list layout in ci benchmark
9182af3 
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
@mhk197
mhk197 force-pushed the mk/enable-list-layout-bench branch from 8947569 to 9182af3 Compare July 28, 2026 11:05
@mhk197 mhk197 added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

do not merge Pull requests that are not intended to merge

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@mhk197